-- Logs begin at Thu 2022-08-18 13:35:04 UTC, end at Thu 2022-08-18 14:46:01 UTC. -- Aug 18 14:16:43.620264 dv-cinder-852209-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 14:16:43.627821 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 14:16:43.629806 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 14:16:43 2022] *** Aug 18 14:16:43.629806 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 14:16:43.629806 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 14:16:43.629806 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: nodename: dv-cinder-852209-4-iscsi Aug 18 14:16:43.629806 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: machine: x86_64 Aug 18 14:16:43.629806 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: clock source: unix Aug 18 14:16:43.629806 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: pcre jit disabled Aug 18 14:16:43.630299 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: detected number of CPU cores: 4 Aug 18 14:16:43.630299 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: current working directory: / Aug 18 14:16:43.630299 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: detected binary path: /usr/bin/uwsgi-core Aug 18 14:16:43.630299 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: your processes number limit is 47680 Aug 18 14:16:43.630299 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: your memory page size is 4096 bytes Aug 18 14:16:43.630299 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: detected max file descriptor number: 2048 Aug 18 14:16:43.630299 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: lock engine: pthread robust mutexes Aug 18 14:16:43.630299 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: thunder lock: enabled Aug 18 14:16:43.630299 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 14:16:43.630299 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 14:16:43.671736 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: Python main interpreter initialized at 0x5558ad6719c0 Aug 18 14:16:43.671736 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: python threads support enabled Aug 18 14:16:43.671736 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: your server socket listen backlog is limited to 100 connections Aug 18 14:16:43.671736 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: your mercy for graceful operations on workers is 90 seconds Aug 18 14:16:43.672147 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 14:16:43.672233 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: *** Operational MODE: preforking *** Aug 18 14:16:43.672439 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: *** uWSGI is running in multiple interpreter mode *** Aug 18 14:16:43.672439 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: spawned uWSGI master process (pid: 105409) Aug 18 14:16:43.672633 dv-cinder-852209-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 14:16:43.677171 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: spawned uWSGI worker 1 (pid: 105410, cores: 1) Aug 18 14:16:43.677171 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: spawned uWSGI worker 2 (pid: 105411, cores: 1) Aug 18 14:16:43.677171 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 14:16:44.340408 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 14:16:44.341594 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 14:16:45.430878 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:16:45.430878 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: from cryptography.utils import int_from_bytes Aug 18 14:16:45.431487 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:16:45.431487 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: from cryptography.utils import int_from_bytes Aug 18 14:16:45.433514 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:16:45.433514 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: from cryptography.utils import int_from_bytes Aug 18 14:16:45.433957 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:16:45.433957 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: from cryptography.utils import int_from_bytes Aug 18 14:16:47.960305 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 14:16:47.960891 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 14:16:47.961071 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 14:16:47.961436 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 14:16:47.961692 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 14:16:47.962044 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 14:16:47.962398 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.962496 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 14:16:47.962580 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.962670 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.962816 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 14:16:47.962986 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.963181 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 14:16:47.963312 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.963460 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 14:16:47.964171 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.964382 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.964519 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.964703 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.964808 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.965022 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.965121 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.965346 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.965440 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.965657 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.965757 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.965971 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.966061 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-4-iscsi {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.966288 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.966391 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.966591 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.966688 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.966900 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.967039 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.967167 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.967328 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.967553 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.967695 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.967825 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-4-iscsi {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.967951 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.968110 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.968239 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.968431 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.968605 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.968721 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.969033 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.969188 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.969335 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.969460 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.969645 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.969843 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.969968 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.970105 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.970277 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.970432 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.970823 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.970997 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.971137 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.971302 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.971455 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.971652 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.971789 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.971989 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.972131 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.972303 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.972424 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-4-iscsi {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.972610 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.972751 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.972928 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.973060 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.973236 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.973366 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.973558 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.973722 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.973860 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.974033 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.974242 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-4-iscsi {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.974373 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.974558 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.974699 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.974869 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.974986 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.975180 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.975281 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.975571 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.975665 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.976006 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.976149 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.976238 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.976315 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.976490 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.976586 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.976789 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.976877 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.977095 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.977181 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.977401 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.977492 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.977725 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.977905 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.978046 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.978175 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.978311 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.978452 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.978588 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.978722 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.978860 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.978995 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.979129 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.979922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.980061 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.980188 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.980314 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.980492 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.980709 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.980848 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.980984 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.981124 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.981256 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.981385 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.981525 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.981662 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.981809 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.981958 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.982089 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.982270 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.982413 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.982552 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.982679 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.982812 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.982940 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.983079 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.983207 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.983397 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.983533 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.983701 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.983839 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.984011 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.984142 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.984319 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.984450 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.984703 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.984854 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.984982 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.985107 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.985309 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.985437 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.985571 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.985713 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.985852 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.985979 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.986105 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.986231 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.986417 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.986558 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.986738 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.986869 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.987047 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.987183 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.987379 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.987523 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.987706 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.987835 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.988012 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.988142 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.988316 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.988447 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.988620 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.988749 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.988936 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.989065 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.989249 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.989385 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.989557 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.989685 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.989819 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.989946 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.990081 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.990209 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.990374 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.990512 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.990688 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.990818 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.990991 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.991121 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.991293 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.991455 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.991622 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.991754 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.991920 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.992050 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.992220 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.992347 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.992520 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.992661 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.992819 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.992954 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.993120 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.993251 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.993423 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.993560 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.993722 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.993851 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.994019 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.994148 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.994320 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.994456 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.994621 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.994789 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.995022 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.995152 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.995294 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.995517 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.995649 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.995776 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.995902 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.996085 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.996225 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.996401 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.996540 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.996713 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.996842 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.997023 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.997160 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.997321 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.997451 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.997644 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.997773 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.997947 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.998087 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.998248 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.998378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.998553 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.998695 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.998853 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.998993 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.999155 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.999288 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.999492 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.999632 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.999791 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:47.999930 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.000095 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.000227 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.000404 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.000532 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.000702 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.000839 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.001005 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.001142 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.001306 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.001445 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.001606 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.001745 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.001906 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.002035 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.002208 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.002344 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.002504 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.002642 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.002803 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.002940 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.003097 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.003228 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.003419 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.003563 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.003727 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.003860 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.004027 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.004164 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.004329 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.004458 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.004626 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.004754 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.004926 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.005131 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.005277 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.005405 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.005546 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.005730 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.005859 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.005986 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.006122 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.006257 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.006416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.006546 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.006722 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.006926 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.007056 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.007190 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.007324 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:16:48.007495 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.007678 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.007818 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.008011 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.008142 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.008341 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.008469 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.008652 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.008799 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.008961 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.009103 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.009275 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.009410 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.009590 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.009721 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.009900 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.010036 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.010211 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.010339 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.010550 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.010680 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.010860 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.011010 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.011155 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.011284 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.011492 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.011751 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.011885 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.012003 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.012128 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.012255 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.012425 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.012558 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.012742 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.012881 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.013059 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.013198 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.013376 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.013500 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.013685 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.013816 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.014001 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.014138 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.014326 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.014458 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.014643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.014772 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.014953 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.015083 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.015302 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.015516 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.015647 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.015847 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.015977 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.016114 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.016242 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.016376 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.016510 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.016644 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.016803 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.016943 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.017113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.017244 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.017428 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.017567 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.017736 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.017876 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.018068 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.018207 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.018382 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.018511 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.018694 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.018831 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.019002 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.019142 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.019314 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.019465 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.019650 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.019780 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.019958 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.020096 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.020266 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.020397 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.020569 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.020701 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.020871 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.021009 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.021173 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.021382 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.021531 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.021668 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.021795 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.021928 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.022056 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.022177 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.022378 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.022510 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.022682 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.022828 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.022992 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.023134 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.023300 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.023490 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.023618 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.023757 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.023931 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.024072 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.024237 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.024367 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.024540 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.024679 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.024851 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.024991 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.025159 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.025305 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.025500 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.025630 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.025757 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.025966 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.026603 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.026736 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.026901 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.027031 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.027215 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.027347 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.027546 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.027680 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.027860 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.027991 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.028171 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.028300 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.028479 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.028608 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.028785 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.028913 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.029095 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.029226 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.029400 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.029537 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.029718 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.029846 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.030051 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.030179 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.030313 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.030440 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.030611 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.030754 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.030926 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.031056 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.031237 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.031414 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.031557 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.031707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.031875 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.032006 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.032193 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.032328 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.032498 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.032643 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.032809 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.032947 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.033113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.033252 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.033416 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.033560 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.033720 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.033851 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.034029 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.034160 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.034332 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.034476 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.034636 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.034766 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.034938 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.035069 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.035240 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.035405 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.035641 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.035773 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.035901 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.036103 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.036247 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.036376 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.036503 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.036629 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.036755 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.036881 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.037031 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.037164 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.037336 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.037473 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.037640 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.037785 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.037945 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.038077 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.038266 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.038397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.038574 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.038714 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.038877 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.039008 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.039182 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.039313 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.039509 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.039652 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.039829 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.039957 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.040133 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.040263 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.040440 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.040624 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.040754 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.040881 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.041052 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.041183 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.041360 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.041496 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.041697 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.042397 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.042568 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.042699 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.042881 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.043014 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.043195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.043329 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.043532 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.043665 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.043837 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.043967 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.044153 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.044285 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.044462 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.044602 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.044788 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.044919 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.045099 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.045230 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.045419 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.045548 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.045765 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.045895 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.046022 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.046231 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.046361 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.046507 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.046644 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.046772 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.046899 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.047025 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.047206 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.047346 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.047554 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.047684 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.047864 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.047994 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.048182 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.048326 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.048491 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.048622 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.048800 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.048929 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.049105 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.049243 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.049414 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.049543 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.049713 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.049843 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.050023 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.050168 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.050332 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.050461 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.050649 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.050781 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.050960 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.051091 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.051267 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.051417 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.051602 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.051734 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.051910 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.052040 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.052194 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.052326 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.052510 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.052641 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.052812 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.052942 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.053116 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.053254 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.053427 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.053557 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.053742 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.053874 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.054051 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.054181 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.054360 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.054499 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.054664 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.054795 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.054977 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.055107 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.055280 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.055452 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.055608 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.055758 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.055963 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.056101 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.056244 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.056445 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.056576 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.056703 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.056829 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.056964 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.057092 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.057226 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.057480 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.057625 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.057783 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.057914 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.058086 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.058255 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.058386 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.058579 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.058711 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.058890 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.059095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.059226 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.059353 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.059513 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.059640 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.059801 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.059945 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.060145 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.060278 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.060456 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.060587 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.060760 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.060899 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.061076 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.061215 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.061395 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.061526 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.061698 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.061835 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.062005 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.062137 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.062313 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.062444 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.062622 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.062753 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.062935 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.063064 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.063243 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.063412 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.063578 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.063710 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.063886 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.064016 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.064191 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.064313 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.064501 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.064640 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.064807 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.064937 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.065127 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.065266 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.065429 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.065558 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.065734 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.065862 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.066076 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.066214 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.066350 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.066553 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.066682 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.066809 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.066944 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.067082 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.067237 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.067490 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.067624 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.067830 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.067961 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.068144 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.068277 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.068458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.068588 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.068770 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.068911 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.069086 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.069216 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.069415 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.069652 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.069785 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.069995 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.070128 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.070319 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.070465 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.070646 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.070778 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.070947 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.071085 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.071250 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.071430 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.071585 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.071716 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.071889 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.072033 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.072191 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.072322 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.072494 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.072634 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.072800 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.072939 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.073197 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.073327 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.073557 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.073687 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.073863 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.074001 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.074170 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.074302 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.074486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.074616 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.074790 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.074920 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.075100 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.075231 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.075433 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.075579 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.075757 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.075903 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.076054 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.076247 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.076376 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.076504 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.076709 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.076851 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.076981 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.077107 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.077233 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.077366 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.077530 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.077671 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.077854 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.077985 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.078165 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.078295 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.078471 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.078611 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.078776 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.078907 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.079080 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.079210 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.079425 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.079557 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.079735 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.079864 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.080039 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.080170 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.080343 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.080475 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.080653 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.080791 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.080962 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.081100 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.081266 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.081397 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.081575 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.081705 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.081889 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.082017 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.082194 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.082326 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.082497 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.082629 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.082796 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.083002 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.083133 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.083259 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.083405 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.083534 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.083712 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.083853 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.084018 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.084146 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.084322 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.084452 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.084625 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.084773 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.084932 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.085061 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.085234 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.085364 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.085537 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.085677 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.085845 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.085976 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.086146 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.086297 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.086506 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.086643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.086856 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.086987 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.087114 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.087249 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.087419 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.087548 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.087675 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.087801 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.087927 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.088054 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.088229 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.088359 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.089043 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.089184 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.089465 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.089596 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.089849 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.089979 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.090155 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.090284 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.090467 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.090607 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.090767 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.090897 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.091069 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.091206 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.091392 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.091539 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.091714 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.091851 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.092022 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.092153 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.092320 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.092457 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.092628 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.092769 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.092927 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.093063 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.093231 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.093374 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.093532 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.093670 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.093840 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.093971 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.094141 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.094273 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.094444 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.094590 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.094745 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.094875 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.095045 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.095175 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.095346 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.095497 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.095930 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.096063 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.096235 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.096366 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.096581 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.096717 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.096860 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.097049 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.097188 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.097317 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.097444 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.097576 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.097694 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.097830 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.098007 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.098139 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.098316 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.098447 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.098621 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.098766 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.098926 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.099058 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.099229 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.099420 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.099595 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.099738 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.099899 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.100029 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.100200 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.100329 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.100511 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.100654 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.100819 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.100950 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.101128 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.101259 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.101431 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.101570 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.101733 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.101863 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.102042 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.102172 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.102348 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.102480 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.102653 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.102792 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.102961 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.103092 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.103273 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.103427 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.103604 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.103735 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.103906 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.104036 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.104272 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.104886 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.105074 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.105206 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.105454 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.105591 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.105765 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.105897 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.106075 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.106214 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.106388 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.106528 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.106738 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.106879 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.107014 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.107219 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.107350 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.107532 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.107661 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.107777 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.107902 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.108037 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.108206 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.108348 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.108513 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.108642 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.108821 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.108966 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.109129 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.109269 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.109442 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.109571 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.109748 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.109878 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.110050 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.110180 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.110352 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.110481 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.110658 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.110787 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.110957 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.111087 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.111280 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.111445 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.111619 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.111750 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.111927 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.112055 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.112240 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.112338 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.112547 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.112636 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.112863 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.112973 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.113169 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.113265 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.113477 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.113598 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.113780 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.113910 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.114194 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.114282 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.114507 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.114613 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.114812 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.114899 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.115117 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.115206 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.115444 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.115547 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.115749 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.115836 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.116055 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.116147 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.116372 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.116470 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.116676 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.116777 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.116978 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.117082 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.117280 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.117367 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.117600 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.117687 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.117904 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.118003 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.118224 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.118313 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.118554 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.118647 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.118861 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.118948 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.119165 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.119260 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.119497 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.119647 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.119854 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.120100 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.120190 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.120492 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.120596 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.120806 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.120893 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.121132 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.121220 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.121457 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.121573 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.121764 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.121876 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.122078 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.122178 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.122388 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.122482 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.122714 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.122826 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.123037 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.123131 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.123347 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.123458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.123684 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.123772 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.123990 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.124077 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.124311 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.124400 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.124632 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.124717 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.124940 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.125042 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.125254 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.125341 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.125574 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.125669 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.125882 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.125983 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.126204 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.126292 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.126525 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.126619 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.126838 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.126935 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.127162 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.127259 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.127487 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.127671 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.127797 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.127994 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.128093 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.128304 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.128395 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.128626 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.128727 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.128950 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.129049 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.129259 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.129349 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.129564 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.129665 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.129872 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.130010 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.130174 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.130304 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.130474 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.130613 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.130794 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.130923 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.131096 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.131244 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.131430 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.131574 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.131744 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.131884 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.132054 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.132185 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.132360 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.132506 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.132661 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.132798 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.132983 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.133113 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.133284 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.133415 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.133586 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.133715 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.133887 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.134017 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.134189 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.134329 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.134527 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.134664 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.134828 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.134957 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.135150 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.135263 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.135513 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.135747 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.135834 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.135915 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.136114 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.136212 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.136422 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.136526 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.136761 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.136864 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.137067 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.137162 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.137384 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.137495 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.137709 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.137826 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.138012 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.138122 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.138320 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.138416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.138627 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.138726 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.138928 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.139016 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.139230 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.139316 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.139560 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.139651 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.139867 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.139962 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.140168 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.140255 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.140468 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.140556 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.140769 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.140856 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.141075 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.141161 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.141382 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.141489 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.141681 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.141778 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.141989 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.142080 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.142290 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.142386 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.142591 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.142679 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.142890 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.142987 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.143208 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.143295 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.143535 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.143627 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.143858 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.143963 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.144165 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.144254 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.144467 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.144555 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.144772 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.144871 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.145077 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.145167 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.145387 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.145517 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.145699 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.145841 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.146013 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.146144 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.146321 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.146450 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.146631 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.146762 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.146944 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.147193 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.147330 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.147481 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.147699 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.147831 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.147958 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.148085 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.148229 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.148395 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.148541 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.148724 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.148864 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.149041 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.149172 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.149353 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.149494 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.149665 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.149804 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.149978 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.150116 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.150291 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.150491 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.150623 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.150820 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.150960 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.151674 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.151990 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.152128 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.152261 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.152390 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.152517 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.152652 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.152855 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.152986 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.153114 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.153249 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.153378 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.153516 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.153652 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.153793 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.153929 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.154058 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.154186 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.154362 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.154497 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.154686 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.154824 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.155009 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.155151 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.155341 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.155526 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.155681 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.155816 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.156003 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.156144 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.156316 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.156445 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.156627 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.156757 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.156933 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.157072 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.157286 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.157435 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.157564 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.157706 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.157918 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.158050 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.158186 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.158322 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.158450 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.158577 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.158714 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.158843 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.159040 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.159172 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.159362 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.159508 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.159695 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.159828 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.160005 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.160133 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.160313 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.160453 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.160624 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.160762 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.160935 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.161138 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.161268 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.161455 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.161588 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.161787 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.161934 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.162126 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.162256 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.162422 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.162555 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.162740 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.162872 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.163058 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.163281 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.163446 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.163621 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.163764 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.163955 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.164088 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.164283 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.164415 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.164590 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.164719 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.164893 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.165025 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.165216 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.165348 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.165530 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.165661 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.165834 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.165965 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.166142 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.166273 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.166453 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.166582 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.167311 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.167583 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.167719 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.167964 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.168111 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.168276 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.168409 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.168581 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.168715 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.168903 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.169046 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.169213 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.169346 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.169554 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.169746 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.169879 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.170093 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.170226 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.170412 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.170554 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.170730 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.170861 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.171052 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.171185 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.171355 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.171518 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.171684 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.171817 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.171996 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.172141 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.172347 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.172477 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.172620 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.172816 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.173154 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.173297 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.173297 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.173565 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.173694 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.173827 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.173956 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.174090 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.174228 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.174356 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.174491 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.174619 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.174753 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.174890 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.175019 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.175187 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.175321 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.175524 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.175658 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.175859 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.176079 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.176256 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.176393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.176532 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.176661 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.176798 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.176927 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.177063 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.177190 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.177349 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.177480 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.177654 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.177785 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.177962 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.178174 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.178305 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.178441 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.178570 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.178698 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.178833 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.178962 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.179147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.179293 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.179469 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.179612 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.179775 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.179908 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.180082 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.180224 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.180393 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.180525 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.180698 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.180837 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.181022 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.181164 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.181327 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.181458 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.181675 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.181877 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.182087 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.182219 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.182422 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.182629 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.182755 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.183029 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.183177 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.183308 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.183468 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.183598 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.183725 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.183862 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.184001 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.184131 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.184393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.184523 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.184705 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.184836 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.185016 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.185157 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.185326 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.185457 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.185636 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.185912 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.186046 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.186241 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.186480 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.186612 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.186846 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.187044 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.187177 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.187476 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.187609 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.187953 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.188083 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.188318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.188604 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.188732 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.188900 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.189167 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.189314 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.189491 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.189624 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.189810 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.189942 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.190122 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.190265 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.190436 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.190685 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.190815 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.191139 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.191270 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.191488 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.191811 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.191940 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.192126 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.192380 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.192520 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.192746 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.192974 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.193107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.193340 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.193568 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.193710 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.193957 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.194255 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.194387 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.194636 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.194818 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.194969 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.195278 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.195635 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.195766 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.195964 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.196095 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.196283 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.196430 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.196599 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.196918 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.197058 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.197241 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.197568 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.197709 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.197885 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.198203 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.198623 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.198860 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.198990 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.199119 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.199255 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.199419 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.199564 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.199704 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.199886 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.200018 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.200226 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.200359 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.200574 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.200707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.200908 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.201049 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.201228 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.201358 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.201536 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.201668 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.201846 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.201976 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.202153 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.202293 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.202465 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.202597 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.202861 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.203002 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.203131 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.203268 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.203422 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.203552 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.203703 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.203835 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.204013 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.204160 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.204302 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.204429 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.204605 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.204736 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.204909 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.205050 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.205211 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.205342 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.205516 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.205653 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.205818 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.205959 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.206118 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.206258 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.206420 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.206557 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.206722 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.206853 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.207022 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.207160 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.207322 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.207474 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.207650 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.207783 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.207954 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.208083 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.208255 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.208384 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.208562 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.208685 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.208864 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.208965 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.209166 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.209265 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.209467 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.209564 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.209770 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.209867 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.210073 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.210179 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.210429 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.210529 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.210679 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.210776 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.211008 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.211115 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.211313 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.211439 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.211657 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.211776 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.211974 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.212076 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.212285 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.212379 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.212590 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.212684 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.212902 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.212994 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.213217 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.213312 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.214048 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.214148 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.214343 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.214434 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.214653 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.214891 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.214980 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.215231 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.215333 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.215569 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.215661 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.215888 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.215985 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.216190 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.216286 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.216500 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.216587 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.216809 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.216896 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.217120 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.217216 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.217431 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.217517 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.217738 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.217833 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.218053 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.218201 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.218357 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.218489 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.218714 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.218855 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.219079 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.219211 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.219340 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.219506 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.219647 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.219786 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.219923 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.220057 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.220185 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.220313 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.220467 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.220861 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.221037 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.221169 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.221350 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.221481 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.221691 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.221830 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.221959 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.222087 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.222251 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.222390 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.222562 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.222696 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.222877 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.223031 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.223225 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.223356 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.223600 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.223733 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.223868 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.223997 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.224154 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.224287 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.224480 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.224614 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.224799 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.224929 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.225108 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.225239 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.225370 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 14:16:48.225507 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.225794 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.226106 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.226422 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.226736 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.227045 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:16:48.227290 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105411) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 14:16:48.380492 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Registered counter for database nova_api Aug 18 14:16:48.381566 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO dbcounter [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Registered counter for database nova_api Aug 18 14:16:48.402621 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:16:48.405146 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG oslo_db.sqlalchemy.engines [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:16:48.410215 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:16:48.411657 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writer thread running {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:16:48.466030 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.context [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c88e209a-0f4b-4562-a6ce-d78b951fe397(cell1) {{(pid=105410) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 14:16:48.467485 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.context [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c88e209a-0f4b-4562-a6ce-d78b951fe397(cell1) {{(pid=105411) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 14:16:48.470048 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:16:48.470793 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:16:48.471619 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:16:48.472108 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:16:48.473460 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:16:48.473664 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:16:48.474410 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:16:48.474800 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:16:48.474901 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:16:48.475685 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:16:48.476934 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG oslo_concurrency.lockutils [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105411) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:16:48.478926 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO dbcounter [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Registered counter for database nova_cell0 Aug 18 14:16:48.479390 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:16:48.482312 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Registered counter for database nova_cell0 Aug 18 14:16:48.485563 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO dbcounter [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Registered counter for database nova_cell1 Aug 18 14:16:48.489232 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Registered counter for database nova_cell1 Aug 18 14:16:48.495393 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG oslo_db.sqlalchemy.engines [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:16:48.497064 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG oslo_db.sqlalchemy.engines [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:16:48.499614 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:16:48.502758 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writer thread running {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:16:48.502888 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:16:48.506999 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:16:48.641672 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writer thread running {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:16:48.645360 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:16:48.652075 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO dbcounter [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Registered counter for database nova_cell0 Aug 18 14:16:48.656182 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO dbcounter [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Registered counter for database nova_cell0 Aug 18 14:16:48.661256 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG oslo_db.sqlalchemy.engines [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105411) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:16:48.663245 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_db.sqlalchemy.engines [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:16:48.665723 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writer thread running {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:16:48.667963 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writer thread running {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:16:49.010414 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: WARNING keystonemiddleware.auth_token [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:16:49.011537 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:16:49.018176 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: WARNING keystonemiddleware.auth_token [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:16:49.018294 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:16:49.363684 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: WARNING keystonemiddleware.auth_token [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:16:49.365663 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:16:49.369625 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: WARNING keystonemiddleware.auth_token [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:16:49.372170 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: WARNING keystonemiddleware.auth_token [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:16:49.375495 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5558ad6719c0 pid: 105411 (default app) Aug 18 14:16:49.377398 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5558ad6719c0 pid: 105410 (default app) Aug 18 14:16:49.377575 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:16:49.378753 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-cc9e8761-b416-418b-bdfd-4c1a5eaf53aa None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001742 Aug 18 14:16:49.379173 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Thu Aug 18 14:16:49 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:18:07.660348 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:07.661550 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Aug 18 14:18:07.661950 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:18:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:18:07.673577 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:SELECT=3 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:18:07.674701 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_cell1:SELECT=3 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:18:07.676198 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_cell0:SELECT=3 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:18:07.677215 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:18:08.552667 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-646e0126-c314-4df9-863d-143ba2e3fe04 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:08.585200 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-646e0126-c314-4df9-863d-143ba2e3fe04 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.915977 Aug 18 14:18:08.586331 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 2/3] 10.222.0.39 () {60 vars in 1292 bytes} [Thu Aug 18 14:18:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:18:10.963132 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:10.964264 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-0cee0c05-027b-48f5-94e4-d7656e3ee177 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 18 14:18:10.964809 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 2/4] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:18:11.421445 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-9456756c-44b2-416b-ade1-6cb73fe9f485 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:11.441533 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:18:11.441533 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: warnings.warn(msg) Aug 18 14:18:11.470838 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-9456756c-44b2-416b-ade1-6cb73fe9f485 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.498913 Aug 18 14:18:11.485565 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=3 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:18:11.486680 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell0:SELECT=3 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:18:11.487719 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell1:SELECT=3 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:18:11.488583 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:18:11.489331 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 3/5] 10.222.0.39 () {64 vars in 1283 bytes} [Thu Aug 18 14:18:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:18:11.700023 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-0394450f-aaf7-42a5-8ba2-dac1222aa71b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:11.704341 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:18:11.704341 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: warnings.warn(msg) Aug 18 14:18:11.772957 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-0394450f-aaf7-42a5-8ba2-dac1222aa71b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292618 Aug 18 14:18:11.773548 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 3/6] 10.222.0.39 () {64 vars in 1336 bytes} [Thu Aug 18 14:18:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:18:14.146883 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-9456756c-44b2-416b-ade1-6cb73fe9f485 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:14.148623 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-9456756c-44b2-416b-ade1-6cb73fe9f485 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002257 Aug 18 14:18:14.149024 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 4/7] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:18:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:18:14.811043 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-db42acf1-77ca-4b71-89e8-4b9bbef0471c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:14.830725 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:18:14.830725 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: warnings.warn(msg) Aug 18 14:18:14.851706 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-db42acf1-77ca-4b71-89e8-4b9bbef0471c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.696408 Aug 18 14:18:14.852269 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 4/8] 10.222.0.39 () {64 vars in 1283 bytes} [Thu Aug 18 14:18:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:18:14.864615 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-816fbc30-c8db-4030-bbf9-52f263c222bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:14.867774 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:18:14.867774 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: warnings.warn(msg) Aug 18 14:18:14.905771 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-816fbc30-c8db-4030-bbf9-52f263c222bf admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044969 Aug 18 14:18:14.906752 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 5/9] 10.222.0.39 () {64 vars in 1336 bytes} [Thu Aug 18 14:18:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:18:17.343162 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-db42acf1-77ca-4b71-89e8-4b9bbef0471c admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:17.344543 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-db42acf1-77ca-4b71-89e8-4b9bbef0471c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002037 Aug 18 14:18:17.344952 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:18:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:18:17.828676 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-9c4500d7-1ae4-4d81-8e8c-c53b68fb1416 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "d2", "ram": 1024, "disk": 10}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:17.848633 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-9c4500d7-1ae4-4d81-8e8c-c53b68fb1416 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496536 Aug 18 14:18:17.849195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 6/11] 10.222.0.39 () {64 vars in 1283 bytes} [Thu Aug 18 14:18:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:18:17.862448 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-ba8e0d54-4303-44d8-8a02-243b2c524c79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:17.889105 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-ba8e0d54-4303-44d8-8a02-243b2c524c79 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030359 Aug 18 14:18:17.889783 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 6/12] 10.222.0.39 () {64 vars in 1336 bytes} [Thu Aug 18 14:18:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:18:20.264077 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-9c4500d7-1ae4-4d81-8e8c-c53b68fb1416 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:20.265679 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-9c4500d7-1ae4-4d81-8e8c-c53b68fb1416 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 Aug 18 14:18:20.267353 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 7/13] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:18:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:18:20.748122 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-53d1b5b3-2dfa-40cf-b207-460b7478f2cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "vcpus": 2}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:20.768348 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-53d1b5b3-2dfa-40cf-b207-460b7478f2cb admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.494697 Aug 18 14:18:20.769438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 7/14] 10.222.0.39 () {64 vars in 1283 bytes} [Thu Aug 18 14:18:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:18:20.781943 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-43c92ae0-095c-4139-8f56-ca0a28105900 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:20.807346 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-43c92ae0-095c-4139-8f56-ca0a28105900 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029463 Aug 18 14:18:20.807959 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 8/15] 10.222.0.39 () {64 vars in 1336 bytes} [Thu Aug 18 14:18:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:18:23.220431 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-53d1b5b3-2dfa-40cf-b207-460b7478f2cb admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:23.221441 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-53d1b5b3-2dfa-40cf-b207-460b7478f2cb admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 18 14:18:23.221844 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 8/16] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:18:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:18:23.666010 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-ab25c857-0def-4c07-b627-d17dba5b8569 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "name": "ds4G"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:23.685573 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-ab25c857-0def-4c07-b627-d17dba5b8569 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.456924 Aug 18 14:18:23.686112 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 9/17] 10.222.0.39 () {64 vars in 1283 bytes} [Thu Aug 18 14:18:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:18:23.698429 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-e98441f1-74ed-477a-ac93-fd925e8d372e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:23.723795 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-e98441f1-74ed-477a-ac93-fd925e8d372e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029220 Aug 18 14:18:23.725052 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 9/18] 10.222.0.39 () {64 vars in 1336 bytes} [Thu Aug 18 14:18:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:18:26.094663 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-ab25c857-0def-4c07-b627-d17dba5b8569 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:26.095676 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-ab25c857-0def-4c07-b627-d17dba5b8569 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 18 14:18:26.096077 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 10/19] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:18:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:18:26.531654 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-24781e1a-cc75-4c03-a198-ae48ec10ab4b admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:26.557836 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-24781e1a-cc75-4c03-a198-ae48ec10ab4b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454782 Aug 18 14:18:26.558382 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 10/20] 10.222.0.39 () {60 vars in 1292 bytes} [Thu Aug 18 14:18:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:18:28.955481 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-ab25c857-0def-4c07-b627-d17dba5b8569 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:28.956432 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-ab25c857-0def-4c07-b627-d17dba5b8569 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 18 14:18:28.956780 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 11/21] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:18:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:18:29.433074 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-96108de8-7c94-4eb0-a2b1-c0d1ebbb453e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "id": "1"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:29.453697 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-96108de8-7c94-4eb0-a2b1-c0d1ebbb453e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.490664 Aug 18 14:18:29.454286 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 11/22] 10.222.0.39 () {64 vars in 1283 bytes} [Thu Aug 18 14:18:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:18:29.467092 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-6682d9f4-70ce-4e38-b819-185c5ab5dc99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:29.492713 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-6682d9f4-70ce-4e38-b819-185c5ab5dc99 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029274 Aug 18 14:18:29.493298 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 12/23] 10.222.0.39 () {64 vars in 1333 bytes} [Thu Aug 18 14:18:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:18:31.836664 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-96108de8-7c94-4eb0-a2b1-c0d1ebbb453e admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:31.837688 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-96108de8-7c94-4eb0-a2b1-c0d1ebbb453e admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 18 14:18:31.838093 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:18:32.241579 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-7844be16-05d7-4cd3-b32b-d5518f046d5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:32.261241 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-7844be16-05d7-4cd3-b32b-d5518f046d5f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.416855 Aug 18 14:18:32.261784 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 13/25] 10.222.0.39 () {64 vars in 1283 bytes} [Thu Aug 18 14:18:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:18:32.274308 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-08cc8df4-1158-4c7e-9d20-283e6c75fbed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:32.298185 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-08cc8df4-1158-4c7e-9d20-283e6c75fbed admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028128 Aug 18 14:18:32.298749 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 13/26] 10.222.0.39 () {64 vars in 1333 bytes} [Thu Aug 18 14:18:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:18:34.698093 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-7844be16-05d7-4cd3-b32b-d5518f046d5f admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:34.699020 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-7844be16-05d7-4cd3-b32b-d5518f046d5f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 18 14:18:34.699477 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 14/27] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:18:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:18:35.101348 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-00c3be11-b28c-4a29-b0ab-07ade04e5267 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "vcpus": 2, "id": "3", "rxtx_factor": 1.0}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:35.123581 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-00c3be11-b28c-4a29-b0ab-07ade04e5267 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.417780 Aug 18 14:18:35.131937 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 14/28] 10.222.0.39 () {64 vars in 1283 bytes} [Thu Aug 18 14:18:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:18:35.137345 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-75cd77e5-d7ba-437d-b3fb-55832f1ea111 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:35.163675 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-75cd77e5-d7ba-437d-b3fb-55832f1ea111 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030154 Aug 18 14:18:35.179427 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 15/29] 10.222.0.39 () {64 vars in 1333 bytes} [Thu Aug 18 14:18:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:18:37.557213 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-00c3be11-b28c-4a29-b0ab-07ade04e5267 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:37.558999 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-00c3be11-b28c-4a29-b0ab-07ade04e5267 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002226 Aug 18 14:18:37.567457 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 15/30] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:18:37 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:18:38.096081 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-54d1ee8b-4588-4666-aaea-0e0e63d1d79b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:38.102182 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:18:38.118215 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-54d1ee8b-4588-4666-aaea-0e0e63d1d79b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.552213 Aug 18 14:18:38.118859 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 16/31] 10.222.0.39 () {64 vars in 1283 bytes} [Thu Aug 18 14:18:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:18:38.131972 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-b54b2105-25dc-42ba-a78e-75a266a58407 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:38.159471 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-b54b2105-25dc-42ba-a78e-75a266a58407 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032239 Aug 18 14:18:38.160167 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 16/32] 10.222.0.39 () {64 vars in 1333 bytes} [Thu Aug 18 14:18:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:18:40.563350 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-54d1ee8b-4588-4666-aaea-0e0e63d1d79b admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:40.566787 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-54d1ee8b-4588-4666-aaea-0e0e63d1d79b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003890 Aug 18 14:18:40.567264 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 17/33] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:18:40 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:18:41.007195 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-53551c26-571b-4819-b002-e1af53970707 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "disk": 160, "rxtx_factor": 1.0}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:41.027465 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-53551c26-571b-4819-b002-e1af53970707 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.453573 Aug 18 14:18:41.028378 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 17/34] 10.222.0.39 () {64 vars in 1283 bytes} [Thu Aug 18 14:18:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:18:41.040257 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c52263b2-2190-4aa6-b292-8329bdeb4a1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:18:41.065549 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c52263b2-2190-4aa6-b292-8329bdeb4a1c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028883 Aug 18 14:18:41.071770 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 18/35] 10.222.0.39 () {64 vars in 1333 bytes} [Thu Aug 18 14:18:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:18:59.965195 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-53551c26-571b-4819-b002-e1af53970707 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:18:59.966222 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-53551c26-571b-4819-b002-e1af53970707 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 18 14:18:59.966628 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 18/36] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:18:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:18:59.977484 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:19:00.359748 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-8da5f147-2b3f-476f-8d6a-37e19b0ee370 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:00.377818 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-8da5f147-2b3f-476f-8d6a-37e19b0ee370 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404992 Aug 18 14:19:00.378355 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 19/37] 10.222.0.39 () {60 vars in 1292 bytes} [Thu Aug 18 14:18:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:19:01.444821 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-53551c26-571b-4819-b002-e1af53970707 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:01.445832 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-53551c26-571b-4819-b002-e1af53970707 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 18 14:19:01.446234 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 19/38] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Aug 18 14:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:19:01.967755 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-bee931da-b12b-4fcb-86c9-0d0ec46c3796 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:01.974121 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.wsgi [None req-bee931da-b12b-4fcb-86c9-0d0ec46c3796 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-bee931da-b12b-4fcb-86c9-0d0ec46c3796 admin admin] Request method failure captured: Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Accept: application/json Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Accept-Encoding: gzip, deflate Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Connection: keep-alive Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Content-Length: 0 Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Host: 10.222.0.39 Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Openstack-Api-Version: compute 2.90 Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Openstack-System-Scope: None Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: User-Agent: python-novaclient Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Auth-Token: gAAAAABi_kpVZ34gi6YY16GFlWRklMsWY5vEV0vbCNiQVG2_mvD__rZTbxV8ZcVVKwvn6XPziUqJlBuZ_fQfjJhfaDGMbBU2oKaY5GQCs8Uav6oDSsv1HnBlyJLj6swOzFZzbYMoui_XkuP-uJLwMtWv-GVSclLi8zX3_-0X_JMGL0-1g78Lnpk Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Domain-Id: None Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Domain-Name: None Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Identity-Status: Confirmed Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Is-Admin-Project: True Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Project-Domain-Id: default Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Project-Domain-Name: Default Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Project-Id: 389b32ba1a734180883a02807c36559d Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Project-Name: admin Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Role: reader,admin,member Aug 18 14:19:01.977458 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Roles: reader,admin,member Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/389b32ba1a734180883a02807c36559d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_389b32ba1a734180883a02807c36559d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/389b32ba1a734180883a02807c36559d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/389b32ba1a734180883a02807c36559d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Tenant: admin Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Tenant-Id: 389b32ba1a734180883a02807c36559d Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Tenant-Name: admin Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User: admin Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User-Domain-Id: default Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User-Domain-Name: Default Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User-Id: 8a72124ed34b4ea59fe9efd6f9ceb251 Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User-Name: admin Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: method: > Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: exception: Flavor 42 could not be found. Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: action_args: {'id': '42'} Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:19:01.979095 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:19:01.980147 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:01.981318 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-bee931da-b12b-4fcb-86c9-0d0ec46c3796 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:19:01.982393 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-bee931da-b12b-4fcb-86c9-0d0ec46c3796 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394335 Aug 18 14:19:01.982393 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 20/39] 10.222.0.39 () {60 vars in 1190 bytes} [Thu Aug 18 14:19:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 14:19:01.988505 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-53a8e5a8-8502-41b7-9501-ff64d98cd891 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:01.994843 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:19:02.016443 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-53a8e5a8-8502-41b7-9501-ff64d98cd891 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031137 Aug 18 14:19:02.017449 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 20/40] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Aug 18 14:19:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:19:02.028003 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-a36f7c13-a194-42c6-a585-a77918ca2da5 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:02.052891 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-a36f7c13-a194-42c6-a585-a77918ca2da5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028510 Aug 18 14:19:02.053435 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 21/41] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Aug 18 14:19:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:19:02.063588 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-cf8d9be5-dcf5-494a-bc23-3ffddef29741 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:02.069632 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.wsgi [None req-cf8d9be5-dcf5-494a-bc23-3ffddef29741 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-cf8d9be5-dcf5-494a-bc23-3ffddef29741 admin admin] Request method failure captured: Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Accept: application/json Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Accept-Encoding: gzip, deflate Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Connection: keep-alive Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Content-Length: 0 Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Host: 10.222.0.39 Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Openstack-Api-Version: compute 2.90 Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Openstack-System-Scope: None Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: User-Agent: python-novaclient Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Auth-Token: gAAAAABi_kpVZ34gi6YY16GFlWRklMsWY5vEV0vbCNiQVG2_mvD__rZTbxV8ZcVVKwvn6XPziUqJlBuZ_fQfjJhfaDGMbBU2oKaY5GQCs8Uav6oDSsv1HnBlyJLj6swOzFZzbYMoui_XkuP-uJLwMtWv-GVSclLi8zX3_-0X_JMGL0-1g78Lnpk Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Domain-Id: None Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Domain-Name: None Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Identity-Status: Confirmed Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Is-Admin-Project: True Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Project-Domain-Id: default Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Project-Domain-Name: Default Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Project-Id: 389b32ba1a734180883a02807c36559d Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Project-Name: admin Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Role: reader,admin,member Aug 18 14:19:02.072852 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Roles: reader,admin,member Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/389b32ba1a734180883a02807c36559d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_389b32ba1a734180883a02807c36559d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/389b32ba1a734180883a02807c36559d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/389b32ba1a734180883a02807c36559d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Tenant: admin Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Tenant-Id: 389b32ba1a734180883a02807c36559d Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Tenant-Name: admin Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User: admin Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User-Domain-Id: default Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User-Domain-Name: Default Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User-Id: 8a72124ed34b4ea59fe9efd6f9ceb251 Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User-Name: admin Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: method: > Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: exception: Flavor 42 could not be found. Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: action_args: {'id': '42'} Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:19:02.074393 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:19:02.075397 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:02.076486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-cf8d9be5-dcf5-494a-bc23-3ffddef29741 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:19:02.077470 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-cf8d9be5-dcf5-494a-bc23-3ffddef29741 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015015 Aug 18 14:19:02.077470 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 21/42] 10.222.0.39 () {60 vars in 1190 bytes} [Thu Aug 18 14:19:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 14:19:03.040376 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-a36f7c13-a194-42c6-a585-a77918ca2da5 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:03.041449 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-a36f7c13-a194-42c6-a585-a77918ca2da5 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 18 14:19:03.041849 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 22/43] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Aug 18 14:19:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:19:03.570666 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-2eaad40b-b18f-4c23-8805-fd027a92e479 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:03.576081 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.wsgi [None req-2eaad40b-b18f-4c23-8805-fd027a92e479 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-2eaad40b-b18f-4c23-8805-fd027a92e479 admin admin] Request method failure captured: Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Accept: application/json Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Accept-Encoding: gzip, deflate Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Connection: keep-alive Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Content-Length: 0 Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Host: 10.222.0.39 Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Openstack-Api-Version: compute 2.90 Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Openstack-System-Scope: None Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: User-Agent: python-novaclient Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Auth-Token: gAAAAABi_kpWUvFjb0nY_xbu2Q9jmax_T6-Q9y2gQca6C9CxXTPtMBCPJnA8m4j_E5nbng9V0yqAxue_da5bi8hgiHF6ijUOvVVtZi-bdfTN4jeYSIJ5FSh_uUKy90aZkMcXsNju-cOoVs2CXujpP8HLdkmvUc9s5vUIKO4IDFEdH9ozpEMmrAU Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Domain-Id: None Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Domain-Name: None Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Identity-Status: Confirmed Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Is-Admin-Project: True Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Project-Domain-Id: default Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Project-Domain-Name: Default Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Project-Id: 389b32ba1a734180883a02807c36559d Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Project-Name: admin Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Role: reader,admin,member Aug 18 14:19:03.577573 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Roles: reader,admin,member Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/389b32ba1a734180883a02807c36559d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_389b32ba1a734180883a02807c36559d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/389b32ba1a734180883a02807c36559d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/389b32ba1a734180883a02807c36559d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Tenant: admin Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Tenant-Id: 389b32ba1a734180883a02807c36559d Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Tenant-Name: admin Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User: admin Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User-Domain-Id: default Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User-Domain-Name: Default Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User-Id: 8a72124ed34b4ea59fe9efd6f9ceb251 Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User-Name: admin Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: method: > Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: exception: Flavor 84 could not be found. Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: action_args: {'id': '84'} Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:19:03.579107 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:19:03.580113 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:03.581438 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-2eaad40b-b18f-4c23-8805-fd027a92e479 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:19:03.582819 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-2eaad40b-b18f-4c23-8805-fd027a92e479 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398957 Aug 18 14:19:03.582819 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 22/44] 10.222.0.39 () {60 vars in 1190 bytes} [Thu Aug 18 14:19:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 14:19:03.589021 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-53bac7e3-7625-4ee8-bb11-b426bf05cea7 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:03.604634 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-53bac7e3-7625-4ee8-bb11-b426bf05cea7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019234 Aug 18 14:19:03.605162 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 23/45] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Aug 18 14:19:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:19:03.615302 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-2fedcf94-5dc7-469f-9e02-d338227bf1e5 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:03.630306 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-2fedcf94-5dc7-469f-9e02-d338227bf1e5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019267 Aug 18 14:19:03.630830 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Aug 18 14:19:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:19:03.639893 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-adbe8c48-d592-4570-b3cf-9c843c55ddaa admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:03.645178 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.wsgi [None req-adbe8c48-d592-4570-b3cf-9c843c55ddaa admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-adbe8c48-d592-4570-b3cf-9c843c55ddaa admin admin] Request method failure captured: Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Accept: application/json Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Accept-Encoding: gzip, deflate Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Connection: keep-alive Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Content-Length: 0 Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Host: 10.222.0.39 Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Openstack-Api-Version: compute 2.90 Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Openstack-System-Scope: None Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: User-Agent: python-novaclient Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Auth-Token: gAAAAABi_kpWUvFjb0nY_xbu2Q9jmax_T6-Q9y2gQca6C9CxXTPtMBCPJnA8m4j_E5nbng9V0yqAxue_da5bi8hgiHF6ijUOvVVtZi-bdfTN4jeYSIJ5FSh_uUKy90aZkMcXsNju-cOoVs2CXujpP8HLdkmvUc9s5vUIKO4IDFEdH9ozpEMmrAU Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Domain-Id: None Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Domain-Name: None Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Identity-Status: Confirmed Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Is-Admin-Project: True Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Project-Domain-Id: default Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Project-Domain-Name: Default Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Project-Id: 389b32ba1a734180883a02807c36559d Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Project-Name: admin Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Role: reader,admin,member Aug 18 14:19:03.646673 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Roles: reader,admin,member Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/389b32ba1a734180883a02807c36559d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_389b32ba1a734180883a02807c36559d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/389b32ba1a734180883a02807c36559d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/389b32ba1a734180883a02807c36559d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Tenant: admin Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Tenant-Id: 389b32ba1a734180883a02807c36559d Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Tenant-Name: admin Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User: admin Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User-Domain-Id: default Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User-Domain-Name: Default Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User-Id: 8a72124ed34b4ea59fe9efd6f9ceb251 Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User-Name: admin Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: method: > Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: exception: Flavor 84 could not be found. Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: action_args: {'id': '84'} Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:19:03.648275 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:19:03.649378 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:03.650707 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-adbe8c48-d592-4570-b3cf-9c843c55ddaa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:19:03.652003 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-adbe8c48-d592-4570-b3cf-9c843c55ddaa admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011672 Aug 18 14:19:03.652003 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 24/47] 10.222.0.39 () {60 vars in 1190 bytes} [Thu Aug 18 14:19:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 14:19:04.618330 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-2fedcf94-5dc7-469f-9e02-d338227bf1e5 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:04.619398 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-2fedcf94-5dc7-469f-9e02-d338227bf1e5 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Aug 18 14:19:04.619814 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 24/48] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Aug 18 14:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:19:05.149134 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-4ff82618-1b68-4edf-a83b-9501adcf0edc admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:05.154876 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.wsgi [None req-4ff82618-1b68-4edf-a83b-9501adcf0edc admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-4ff82618-1b68-4edf-a83b-9501adcf0edc admin admin] Request method failure captured: Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Accept: application/json Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Accept-Encoding: gzip, deflate Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Connection: keep-alive Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Content-Length: 0 Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Host: 10.222.0.39 Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Openstack-Api-Version: compute 2.90 Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Openstack-System-Scope: None Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: User-Agent: python-novaclient Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Auth-Token: gAAAAABi_kpYh1fRXsiWznsn92PkK8yj4SDXmKYTbvRBhSy1sjkzVIAKAgISWYBgPNEP9GUIUpxSyOKB2zQZMJWFTsLJbY9hUBEfVsy15-N7lrbts4xefAxNEexKw2BuLb5fZUX-b0ejLzB6DdqPW5UUnjZcn3Ajn5kRW-7GCN0pa0bwvw1sTCU Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Domain-Id: None Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Domain-Name: None Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Identity-Status: Confirmed Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Is-Admin-Project: True Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Project-Domain-Id: default Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Project-Domain-Name: Default Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Project-Id: 389b32ba1a734180883a02807c36559d Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Project-Name: admin Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Role: reader,admin,member Aug 18 14:19:05.156416 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Roles: reader,admin,member Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/389b32ba1a734180883a02807c36559d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_389b32ba1a734180883a02807c36559d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/389b32ba1a734180883a02807c36559d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/389b32ba1a734180883a02807c36559d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Tenant: admin Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Tenant-Id: 389b32ba1a734180883a02807c36559d Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-Tenant-Name: admin Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User: admin Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User-Domain-Id: default Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User-Domain-Name: Default Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User-Id: 8a72124ed34b4ea59fe9efd6f9ceb251 Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: X-User-Name: admin Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: method: > Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: exception: Flavor 451 could not be found. Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: action_args: {'id': '451'} Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:19:05.158028 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:19:05.158922 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: ERROR nova.api.openstack.wsgi Aug 18 14:19:05.160195 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-4ff82618-1b68-4edf-a83b-9501adcf0edc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105411) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:19:05.161825 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-4ff82618-1b68-4edf-a83b-9501adcf0edc admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.400789 Aug 18 14:19:05.161825 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 25/49] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Aug 18 14:19:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 14:19:05.168351 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-fcb8c20d-4def-4f83-ad2e-57386abe9d3d admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:05.184087 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-fcb8c20d-4def-4f83-ad2e-57386abe9d3d admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019285 Aug 18 14:19:05.184607 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 25/50] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Aug 18 14:19:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:19:05.194709 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:05.210424 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019987 Aug 18 14:19:05.210959 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 26/51] 10.222.0.39 () {60 vars in 1210 bytes} [Thu Aug 18 14:19:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:19:05.220563 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-8f7b84e8-fa1e-46c3-ac45-47986061b5ae admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:05.226486 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.wsgi [None req-8f7b84e8-fa1e-46c3-ac45-47986061b5ae admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-8f7b84e8-fa1e-46c3-ac45-47986061b5ae admin admin] Request method failure captured: Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Accept: application/json Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Accept-Encoding: gzip, deflate Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Connection: keep-alive Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Content-Length: 0 Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Host: 10.222.0.39 Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Openstack-Api-Version: compute 2.90 Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Openstack-System-Scope: None Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: User-Agent: python-novaclient Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Auth-Token: gAAAAABi_kpYh1fRXsiWznsn92PkK8yj4SDXmKYTbvRBhSy1sjkzVIAKAgISWYBgPNEP9GUIUpxSyOKB2zQZMJWFTsLJbY9hUBEfVsy15-N7lrbts4xefAxNEexKw2BuLb5fZUX-b0ejLzB6DdqPW5UUnjZcn3Ajn5kRW-7GCN0pa0bwvw1sTCU Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Domain-Id: None Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Domain-Name: None Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Identity-Status: Confirmed Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Is-Admin-Project: True Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Project-Domain-Id: default Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Project-Domain-Name: Default Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Project-Id: 389b32ba1a734180883a02807c36559d Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Project-Name: admin Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Role: reader,admin,member Aug 18 14:19:05.228034 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Roles: reader,admin,member Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/389b32ba1a734180883a02807c36559d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_389b32ba1a734180883a02807c36559d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/389b32ba1a734180883a02807c36559d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/389b32ba1a734180883a02807c36559d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Tenant: admin Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Tenant-Id: 389b32ba1a734180883a02807c36559d Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-Tenant-Name: admin Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User: admin Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User-Domain-Id: default Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User-Domain-Name: Default Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User-Id: 8a72124ed34b4ea59fe9efd6f9ceb251 Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: X-User-Name: admin Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: method: > Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: exception: Flavor 451 could not be found. Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: action_args: {'id': '451'} Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:19:05.229643 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:19:05.230707 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: ERROR nova.api.openstack.wsgi Aug 18 14:19:05.232094 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-8f7b84e8-fa1e-46c3-ac45-47986061b5ae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:19:05.233351 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-8f7b84e8-fa1e-46c3-ac45-47986061b5ae admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012743 Aug 18 14:19:05.233351 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 26/52] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Aug 18 14:19:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 14:19:06.192758 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:06.193766 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002105 Aug 18 14:19:06.194157 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Aug 18 14:19:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:19:06.727816 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-8e774e42-a9d5-4fac-9002-0a0b1b654f57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:19:06.746572 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-8e774e42-a9d5-4fac-9002-0a0b1b654f57 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.414823 Aug 18 14:19:06.747115 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 27/54] 10.222.0.39 () {64 vars in 1235 bytes} [Thu Aug 18 14:19:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:19:07.734845 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:07.735910 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 18 14:19:07.736310 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 28/55] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Aug 18 14:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:19:08.276629 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-90977ee1-a6c2-433b-aaf5-aae0fb710c81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:19:08.297918 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-90977ee1-a6c2-433b-aaf5-aae0fb710c81 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.420359 Aug 18 14:19:08.298465 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 28/56] 10.222.0.39 () {64 vars in 1235 bytes} [Thu Aug 18 14:19:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:19:09.280751 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:09.281772 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 18 14:19:09.282172 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 29/57] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Aug 18 14:19:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:19:09.805317 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-55d43ffe-4ebf-4bdf-a64d-df890c3f60a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:19:09.824772 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-55d43ffe-4ebf-4bdf-a64d-df890c3f60a3 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.404082 Aug 18 14:19:09.825309 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 29/58] 10.222.0.39 () {64 vars in 1235 bytes} [Thu Aug 18 14:19:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:19:10.826305 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:10.827639 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 Aug 18 14:19:10.828038 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 30/59] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Aug 18 14:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:19:11.365647 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-73885a87-ff90-4b51-bad7-4abd656c4100 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:19:11.384796 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-73885a87-ff90-4b51-bad7-4abd656c4100 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.409941 Aug 18 14:19:11.385339 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 30/60] 10.222.0.39 () {64 vars in 1235 bytes} [Thu Aug 18 14:19:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:19:12.373009 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:12.374022 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 18 14:19:12.374423 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 31/61] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Aug 18 14:19:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:19:12.907808 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-6da7f4d3-62ac-44d8-85cf-ccb9d35a7698 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:19:12.930197 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-6da7f4d3-62ac-44d8-85cf-ccb9d35a7698 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.416424 Aug 18 14:19:12.930785 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 31/62] 10.222.0.39 () {60 vars in 1202 bytes} [Thu Aug 18 14:19:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:20:06.962460 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:20:06.963527 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-62788ae5-8473-45ac-a495-880268ab46c1 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 18 14:20:06.963939 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 32/63] 10.222.0.39 () {54 vars in 931 bytes} [Thu Aug 18 14:20:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:20:06.975033 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:20:07.358542 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-f3b5a050-8cbe-4c5b-8808-aac14992532b admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:20:07.379960 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-f3b5a050-8cbe-4c5b-8808-aac14992532b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409897 Aug 18 14:20:07.380500 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 32/64] 10.222.0.39 () {60 vars in 1292 bytes} [Thu Aug 18 14:20:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:20:07.401597 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG dbcounter [-] [105411] Writing DB stats nova_api:SELECT=14 {{(pid=105411) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:20:07.405297 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-89bfc7ff-ceba-4a20-92ee-85ad6887cd5b admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:20:07.413750 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-89bfc7ff-ceba-4a20-92ee-85ad6887cd5b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013515 Aug 18 14:20:07.414277 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 33/65] 10.222.0.39 () {60 vars in 1283 bytes} [Thu Aug 18 14:20:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:20:07.426687 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-092c900e-29cb-44ed-9804-5865c5923e20 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:20:07.434367 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-092c900e-29cb-44ed-9804-5865c5923e20 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011980 Aug 18 14:20:07.434875 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 33/66] 10.222.0.39 () {60 vars in 1286 bytes} [Thu Aug 18 14:20:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:20:07.446146 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c232d308-907a-4839-a50b-6c04e5ee6f03 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:20:07.453580 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c232d308-907a-4839-a50b-6c04e5ee6f03 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010958 Aug 18 14:20:07.454130 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 34/67] 10.222.0.39 () {60 vars in 1286 bytes} [Thu Aug 18 14:20:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:20:07.465933 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-e4138a4c-3b72-4845-92f3-299810b938e1 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:20:07.474257 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-e4138a4c-3b72-4845-92f3-299810b938e1 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011878 Aug 18 14:20:07.474787 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 34/68] 10.222.0.39 () {60 vars in 1283 bytes} [Thu Aug 18 14:20:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:23:01.616314 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c232d308-907a-4839-a50b-6c04e5ee6f03 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:23:01.617362 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c232d308-907a-4839-a50b-6c04e5ee6f03 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 18 14:23:01.617761 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 35/69] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Aug 18 14:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:23:01.765296 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=6 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:23:01.929579 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-51cc161b-d223-469a-b768-faab54761486 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:23:01.931968 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:23:01.931968 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: warnings.warn(msg) Aug 18 14:23:01.933088 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-51cc161b-d223-469a-b768-faab54761486 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:23:01.933564 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-51cc161b-d223-469a-b768-faab54761486 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:23:01.933993 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-51cc161b-d223-469a-b768-faab54761486 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:23:01.934702 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-51cc161b-d223-469a-b768-faab54761486 admin admin] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:23:01.935152 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-51cc161b-d223-469a-b768-faab54761486 admin admin] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:23:01.935597 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-51cc161b-d223-469a-b768-faab54761486 admin admin] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:23:01.968639 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-51cc161b-d223-469a-b768-faab54761486 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204802 Aug 18 14:23:01.969208 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 35/70] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Aug 18 14:23:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:23:02.807963 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c232d308-907a-4839-a50b-6c04e5ee6f03 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:23:02.808961 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c232d308-907a-4839-a50b-6c04e5ee6f03 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 18 14:23:02.809357 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 36/71] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Aug 18 14:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:23:02.998209 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-905ea2cf-a458-4360-9f70-28e8c502b64d admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:23:03.000631 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:23:03.000631 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: warnings.warn(msg) Aug 18 14:23:03.001734 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-905ea2cf-a458-4360-9f70-28e8c502b64d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:23:03.002210 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-905ea2cf-a458-4360-9f70-28e8c502b64d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:23:03.002641 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-905ea2cf-a458-4360-9f70-28e8c502b64d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:23:03.003358 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-905ea2cf-a458-4360-9f70-28e8c502b64d admin admin] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:23:03.003854 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-905ea2cf-a458-4360-9f70-28e8c502b64d admin admin] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:23:03.004275 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-905ea2cf-a458-4360-9f70-28e8c502b64d admin admin] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:23:03.026296 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-905ea2cf-a458-4360-9f70-28e8c502b64d admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080142 Aug 18 14:23:03.026787 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 36/72] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Aug 18 14:23:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:23:14.261313 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c232d308-907a-4839-a50b-6c04e5ee6f03 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:23:14.262322 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c232d308-907a-4839-a50b-6c04e5ee6f03 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 18 14:23:14.262727 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 37/73] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Aug 18 14:23:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:23:14.406408 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell0:SELECT=4 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:23:14.407121 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_cell1:SELECT=4 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:23:14.407762 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG dbcounter [-] [105410] Writing DB stats nova_api:SELECT=8 {{(pid=105410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:23:14.455469 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-4660b1ba-4455-4ba8-a1f0-2ac8ea8675c0 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:23:14.457850 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:23:14.457850 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: warnings.warn(msg) Aug 18 14:23:14.458937 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-4660b1ba-4455-4ba8-a1f0-2ac8ea8675c0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:23:14.459431 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-4660b1ba-4455-4ba8-a1f0-2ac8ea8675c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:23:14.459859 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-4660b1ba-4455-4ba8-a1f0-2ac8ea8675c0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:23:14.460563 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-4660b1ba-4455-4ba8-a1f0-2ac8ea8675c0 admin admin] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:23:14.461005 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-4660b1ba-4455-4ba8-a1f0-2ac8ea8675c0 admin admin] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:23:14.461421 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-4660b1ba-4455-4ba8-a1f0-2ac8ea8675c0 admin admin] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:23:14.487466 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-4660b1ba-4455-4ba8-a1f0-2ac8ea8675c0 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085373 Aug 18 14:23:14.487951 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 37/74] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Aug 18 14:23:14 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:23:15.322568 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: DEBUG nova.api.openstack.wsgi [None req-c232d308-907a-4839-a50b-6c04e5ee6f03 admin admin] Calling method '>' {{(pid=105411) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:23:15.323608 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: INFO nova.api.openstack.requestlog [None req-c232d308-907a-4839-a50b-6c04e5ee6f03 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002232 Aug 18 14:23:15.324012 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: [pid: 105411|app: 0|req: 38/75] 10.222.0.39 () {56 vars in 1074 bytes} [Thu Aug 18 14:23:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:23:15.512828 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG nova.api.openstack.wsgi [None req-5990a93a-9c4b-4970-8a45-7bdf639e6522 admin admin] Calling method '>' {{(pid=105410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:23:15.515190 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 14:23:15.515190 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: warnings.warn(msg) Aug 18 14:23:15.516319 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-5990a93a-9c4b-4970-8a45-7bdf639e6522 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:23:15.516792 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-5990a93a-9c4b-4970-8a45-7bdf639e6522 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:23:15.517217 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-5990a93a-9c4b-4970-8a45-7bdf639e6522 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:23:15.517924 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-5990a93a-9c4b-4970-8a45-7bdf639e6522 admin admin] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:23:15.518369 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-5990a93a-9c4b-4970-8a45-7bdf639e6522 admin admin] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:23:15.518784 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: DEBUG oslo_concurrency.lockutils [None req-5990a93a-9c4b-4970-8a45-7bdf639e6522 admin admin] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:23:15.540723 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: INFO nova.api.openstack.requestlog [None req-5990a93a-9c4b-4970-8a45-7bdf639e6522 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079407 Aug 18 14:23:15.541456 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: [pid: 105410|app: 0|req: 38/76] 10.222.0.39 () {60 vars in 1193 bytes} [Thu Aug 18 14:23:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:24:11.437114 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: Thu Aug 18 14:24:11 2022 - graceful shutdown triggered... Aug 18 14:24:11.437621 dv-cinder-852209-4-iscsi devstack@n-api.service[105410]: Gracefully killing worker 1 (pid: 105410)... Aug 18 14:24:11.437240 dv-cinder-852209-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 18 14:24:11.438422 dv-cinder-852209-4-iscsi devstack@n-api.service[105411]: Gracefully killing worker 2 (pid: 105411)... Aug 18 14:24:12.438256 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: worker 1 buried after 1 seconds Aug 18 14:24:12.438711 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: worker 2 buried after 1 seconds Aug 18 14:24:12.438711 dv-cinder-852209-4-iscsi devstack@n-api.service[105409]: goodbye to uWSGI. Aug 18 14:24:12.439896 dv-cinder-852209-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 18 14:24:12.440461 dv-cinder-852209-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 18 14:24:12.443276 dv-cinder-852209-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 14:24:12.453157 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 14:24:12.455251 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 14:24:12 2022] *** Aug 18 14:24:12.455251 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 14:24:12.455251 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 14:24:12.455251 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: nodename: dv-cinder-852209-4-iscsi Aug 18 14:24:12.455251 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: machine: x86_64 Aug 18 14:24:12.455251 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: clock source: unix Aug 18 14:24:12.455251 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: pcre jit disabled Aug 18 14:24:12.455251 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: detected number of CPU cores: 4 Aug 18 14:24:12.455251 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: current working directory: / Aug 18 14:24:12.455251 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: detected binary path: /usr/bin/uwsgi-core Aug 18 14:24:12.455251 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: your processes number limit is 47680 Aug 18 14:24:12.456091 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: your memory page size is 4096 bytes Aug 18 14:24:12.456091 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: detected max file descriptor number: 2048 Aug 18 14:24:12.456091 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: lock engine: pthread robust mutexes Aug 18 14:24:12.456091 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: thunder lock: enabled Aug 18 14:24:12.456091 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 14:24:12.456091 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 14:24:12.497834 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: Python main interpreter initialized at 0x5598ecb969c0 Aug 18 14:24:12.497834 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: python threads support enabled Aug 18 14:24:12.497834 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: your server socket listen backlog is limited to 100 connections Aug 18 14:24:12.497834 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: your mercy for graceful operations on workers is 90 seconds Aug 18 14:24:12.498300 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 14:24:12.498300 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: *** Operational MODE: preforking *** Aug 18 14:24:12.498541 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: *** uWSGI is running in multiple interpreter mode *** Aug 18 14:24:12.498541 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: spawned uWSGI master process (pid: 120518) Aug 18 14:24:12.498749 dv-cinder-852209-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 14:24:12.499308 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: spawned uWSGI worker 1 (pid: 120538, cores: 1) Aug 18 14:24:12.499839 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: spawned uWSGI worker 2 (pid: 120539, cores: 1) Aug 18 14:24:12.500240 dv-cinder-852209-4-iscsi devstack@n-api.service[120518]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 14:24:13.164914 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 14:24:13.165538 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 14:24:14.335315 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:24:14.335315 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: from cryptography.utils import int_from_bytes Aug 18 14:24:14.336057 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:24:14.336057 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: from cryptography.utils import int_from_bytes Aug 18 14:24:14.337938 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:24:14.337938 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: from cryptography.utils import int_from_bytes Aug 18 14:24:14.338388 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 14:24:14.338388 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: from cryptography.utils import int_from_bytes Aug 18 14:24:16.763783 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 14:24:16.764885 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 14:24:16.764885 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 14:24:16.764885 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 14:24:16.765111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 14:24:16.765474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.765815 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.766142 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.766341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 14:24:16.766715 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.766801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 14:24:16.766885 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.767093 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.767201 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 14:24:16.767464 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.767603 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 14:24:16.767772 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 14:24:16.767878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.768137 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.768242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.768397 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.768502 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.768718 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.768828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.769047 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-4-iscsi {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.769147 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.769377 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.769485 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.769694 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.769866 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.770034 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.770139 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.770334 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.770492 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.770667 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.770779 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.770942 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.771102 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.771273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.771406 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.771594 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-4-iscsi {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.771903 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.772094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.772363 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.772681 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.773008 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.773315 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.773642 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.773859 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.774091 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.774313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.774542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.774765 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.774999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.775226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.775461 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.775702 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.775939 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.776184 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.776405 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.776626 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.776845 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.777067 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.777842 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.778095 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.778319 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.778540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.778540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.778970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-4-iscsi {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.779159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.779349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.779349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.779712 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.779926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.780085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-4-iscsi {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.780233 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.780388 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.780543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.780741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.780898 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.781062 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.781217 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.781376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.781565 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.781751 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.781912 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.782245 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.782401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.782556 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.782704 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.782860 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.783034 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.783260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.783441 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.783623 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.783777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.783932 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.784080 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.784243 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.784399 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.784557 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.784787 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.784947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.785105 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.785261 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.785415 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.785570 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.785727 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.785873 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.786026 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.786202 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.786487 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.786639 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.786872 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.787021 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.787177 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.787333 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.787506 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.787506 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.787815 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.787960 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.788106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.788271 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.788426 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.788426 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.788728 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.788883 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.789037 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.789188 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.789344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.789500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.789655 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.789812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.789968 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.790120 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.790278 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.790423 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.790567 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.790722 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.790875 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.791034 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.791188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.791341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.791571 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.791719 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.791864 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.792030 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.792216 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.792478 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.792632 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.792789 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.792988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.793748 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.793911 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.794200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.794361 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.794520 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.794675 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.794836 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.795004 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.795162 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.795316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.795503 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.795661 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.795817 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.795965 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.796111 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.796256 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.796411 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.796663 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.796818 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.796964 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.797128 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.797275 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.797429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.797584 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.797737 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.797884 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.798037 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.798195 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.798195 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.798490 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.798637 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.798792 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.798958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.799312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.799498 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.799660 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.799815 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.799969 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.800124 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.800270 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.800425 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.800572 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.800729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.800875 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.801020 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.801182 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.801339 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.801493 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.801639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.801792 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.801939 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.802092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.802252 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.802399 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.802648 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.802812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.802967 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.803113 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.803280 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.803458 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.803621 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.803867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.804028 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.804183 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.804343 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.804491 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.804644 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.804790 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.804953 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.805110 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.805265 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.805429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.805591 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.805737 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.805890 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.806044 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.806197 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.806350 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.806507 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.806672 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.806887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.807054 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.807211 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.807357 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.807560 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.807719 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.807874 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.808029 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.808183 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.808329 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.808482 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.808704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.808908 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.809114 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.809306 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.809502 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.809699 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.809902 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.810118 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.810335 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.810545 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.810754 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.810959 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.811157 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.811403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.811625 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.811858 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.812061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.812278 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.812499 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.812812 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.813009 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.813226 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.813433 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.813654 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.813888 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.814205 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.814443 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.814640 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.814799 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.814954 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.815100 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.815267 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.815442 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.815603 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.815757 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.815903 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.816059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.816059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.816336 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.816489 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.816635 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.816787 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.817037 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.817191 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 14:24:16.817349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.817502 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.817649 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.817795 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.818023 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.818179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.818326 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.818480 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.819219 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.819406 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.819585 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.819742 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.819903 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.820058 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.820213 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.820366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.820747 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.820905 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.821066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.821213 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.821360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.821511 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.821666 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.821836 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.821983 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.822128 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.822287 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.822445 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.822592 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.822764 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.823017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.823168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.823321 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.823543 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.823694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.823848 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.824020 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.824216 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.824468 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.824637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.824787 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.824932 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.825088 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.825235 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.825389 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.825544 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.825691 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.825836 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.826005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.826159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.826315 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.826483 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.826641 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.826796 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.826954 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.827197 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.827350 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.827533 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.827682 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.827837 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.827991 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.828163 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.828317 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.828471 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.828625 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.828784 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.828931 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.829076 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.829221 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.829372 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.829529 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.829690 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.829847 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.830034 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.830202 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.830348 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.830508 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.830661 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.830809 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.830962 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.831115 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.831115 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.831443 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.831597 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.831744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.831890 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.832042 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.832206 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.832365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.832561 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.832723 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.832872 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.833035 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.833275 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.833436 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.833584 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.833955 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.834106 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.834284 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.834461 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.834716 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.834878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.835025 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.835170 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.835315 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.835503 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.835670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.835826 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.835974 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.836119 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.836264 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.836419 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.836589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.836736 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.836897 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.837045 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.837209 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.837443 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.837595 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.837755 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.837901 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.838047 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.838192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.838351 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.838497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.838497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.838497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.838497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.838497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.839198 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.839342 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.839581 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.839729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.840467 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.840631 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.840779 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.840923 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.841077 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.841250 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.841405 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.841559 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.841706 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.841850 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.842002 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.842156 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.842311 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.842466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.842613 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.842757 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.842948 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.843095 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.843289 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.843545 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.843700 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.843854 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.844002 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.844147 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.844301 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.844456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.844606 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.844789 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.845009 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.845217 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.845405 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.845583 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.845982 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.846128 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.846281 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.846436 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.846669 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.846819 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.846978 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.847124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.847277 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.847474 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.847697 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.847868 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.848023 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.848177 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.848350 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.848512 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.848659 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.848804 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.848956 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.849101 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.849254 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.849441 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.849592 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.849743 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.849899 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.850071 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.850219 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.850377 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.850533 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.850679 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.850825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.850969 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.851122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.851268 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.851432 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.851595 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.851750 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.851908 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.852068 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.852223 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.852376 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.852533 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.852679 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.852824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.852978 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.852978 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.853261 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.853418 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.853418 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.853820 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.853982 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.854136 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.854293 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.854293 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.854587 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.854743 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.854743 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.855019 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.855164 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.855164 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.855509 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.856197 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.856197 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.856673 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.856831 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.856831 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.857115 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.857277 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.857431 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.857585 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.857585 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.857972 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.857972 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.858257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.858404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.858404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.858717 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.858864 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.859009 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.859169 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.859169 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.859637 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.859637 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.859914 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.860077 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.860225 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.860371 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.860371 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.860656 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.860812 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.860812 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.861103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.861248 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.861401 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.861547 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.861701 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.861856 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.862009 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.862009 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.862296 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.862450 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.862450 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.862754 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.862908 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.862908 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.863199 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.863346 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.863346 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.863684 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.863921 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.864078 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.864237 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.864383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.864553 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.864708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.864861 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.865014 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.865160 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.865306 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.865463 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.865609 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.865770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.865932 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.865932 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.866207 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.866366 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.866366 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.866663 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.866815 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.866815 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.867108 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.867254 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.867254 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.867570 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.867717 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.867959 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.868127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.868274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.868428 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.868584 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.868729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.868923 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.869141 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.869341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.869532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.869728 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.869924 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.870120 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.870328 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.870540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.870742 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.870938 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.871183 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.871417 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.871626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.871833 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.872036 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.872196 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.872344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.872507 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.872707 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.872897 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.873085 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.873273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.873469 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.873681 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.873903 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.874207 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.874408 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.874607 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.874808 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.875014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.875205 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.875465 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.875623 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.875770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.875927 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.876128 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.876320 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.876508 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.876508 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.876886 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.877086 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.877279 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.877499 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.877695 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.877695 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.878153 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.878153 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.878620 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.878834 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.879025 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.879180 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.879326 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.879326 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.879650 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.879795 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.879949 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.880097 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.880249 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.880404 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.880567 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.880567 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.880872 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.880872 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.881170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.881325 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.881476 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.881635 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.881794 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.881957 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.882119 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.882280 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.882433 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.882586 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.882745 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.882745 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.883071 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.883227 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.883410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.883582 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.883744 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.883914 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.884321 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.884321 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.884619 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.884780 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.884954 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.885108 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.885260 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.885260 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.885555 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.885715 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.885877 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.886043 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.886204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.886368 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.886521 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.887238 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.887476 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.887647 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.887801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.887972 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.888146 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.888374 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.888542 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.888703 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.888703 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.889010 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.889171 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.889339 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.889504 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.889658 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.889830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.889983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.890143 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.890296 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.890459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.890619 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.890772 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.890924 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.891077 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.891229 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.891491 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.891654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.891820 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.891985 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.892146 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.892307 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.892474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.892629 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.892781 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.892940 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.893094 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.893255 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.893408 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.893569 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.893569 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.893871 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.893871 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.894214 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.894214 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.894619 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.894774 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.894926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.895078 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.895244 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.895417 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.895577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.895742 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.895896 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.896059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.896221 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.896374 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.896534 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.896729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.896891 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.897053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.897208 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.897368 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.897529 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.897529 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.897820 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.897981 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.898153 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.898314 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.898561 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.898721 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.898876 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.899039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.899192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.899344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.899546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.899546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.899546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.900001 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.900174 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.900328 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.900480 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.900646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.900814 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.900969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.901128 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.901281 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.901433 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.901593 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.901793 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.901948 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.902102 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.902304 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.903038 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.903196 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.903406 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.903604 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.903760 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.903914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.903914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.904215 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.904387 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.904645 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.904807 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.904960 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.905133 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.905296 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.905458 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.905620 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.905773 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.905933 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.906085 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.906251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.906406 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.906557 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.906719 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.906879 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.907039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.907211 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.907401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.907573 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.907737 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.907890 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.908042 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.908207 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.908362 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.908530 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.908756 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.908921 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.909085 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.909238 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.909410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.909564 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.909717 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.909875 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.910112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.910275 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.910438 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.910592 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.910753 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.910907 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.911073 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.911234 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.911431 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.911592 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.911753 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.911906 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.912071 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.912240 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.912394 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.912555 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.912715 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.912883 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.913037 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.913197 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.913358 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.913530 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.913691 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.913853 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.914017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.914181 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.914343 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.914503 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.914686 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.914929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.915089 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.915249 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.915427 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.915589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.915754 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.915922 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.915922 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.916214 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.916372 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.916533 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.916700 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.916863 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.917023 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.917176 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.917335 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.917495 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.917733 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.917933 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.918094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.918347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.918347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.918653 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.918911 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.919079 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.919234 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.919449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.919612 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.919778 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.919948 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.920110 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.920275 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.920435 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.920588 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.920753 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.920916 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.921077 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.921230 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.921389 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.921550 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.921720 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.921874 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.922034 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.922199 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.922352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.922504 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.922669 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.922831 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.922985 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.923137 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.923298 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.923495 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.923660 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.923814 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.923973 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.924147 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.924313 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.924465 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.924627 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.924788 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.924963 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.925203 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.925363 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.925529 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.925684 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.925860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.926026 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.926182 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.926334 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.926511 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.926666 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.926844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.926997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.926997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.927296 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.927296 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.927650 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.927810 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.927971 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.928124 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.928284 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.928447 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.928611 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.928774 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.929027 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.929189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.929357 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.929521 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.929700 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.929700 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.929897 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.929997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.930099 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.930197 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.930294 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.930389 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.930478 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.930572 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.930670 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.930766 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.930861 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.930956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.931054 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.931054 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.931228 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.931316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.931452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.931452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.931632 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.931733 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.931822 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.931908 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.932001 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.932095 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.932182 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.932303 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.932404 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.932499 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.932586 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.932672 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.932778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.932778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.932927 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.933010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.933084 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.933165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.933268 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.933359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.933457 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.933561 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.933656 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.933736 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.933819 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.933901 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.934166 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.934166 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.934307 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.934380 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.934465 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.934548 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.934623 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.934695 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.934767 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.934840 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.934923 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.934998 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.935078 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.935160 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.935242 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.935322 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.935434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.935513 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.935596 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.935677 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.935774 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.935774 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.935928 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.936009 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.936082 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.936082 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.936231 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.936318 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.936400 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.936474 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.936547 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.936627 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.936701 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.936780 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.936854 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.936926 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.937006 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.937006 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.937147 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.937220 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.937300 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.937374 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.937445 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.937539 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.937629 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.937716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.937809 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.937809 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.937977 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.938071 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.938160 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.938246 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.938331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.938417 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.938512 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.938512 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.938692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.938779 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.938872 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.938958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.939178 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.939280 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.939395 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.939486 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.939583 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.939720 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.939823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.939913 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.939999 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.940093 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.940180 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.940280 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.940380 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.940468 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.940553 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.940647 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.940742 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.940842 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.940931 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.941017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.941111 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.941198 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.941285 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.941384 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.941471 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.941558 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.941643 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.941736 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.941831 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.941973 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.942077 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.942304 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.942401 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.942620 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.942722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.942932 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.943027 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.943247 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.943344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.943589 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.943734 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.943922 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.944025 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.944234 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.944373 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.944559 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.944667 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.944870 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.944966 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.945183 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.945293 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.945496 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.945660 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.945807 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.945902 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.946157 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.946251 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.946470 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.946575 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.946795 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.946890 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.947125 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.947227 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.947472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.947572 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.947784 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.947878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.948098 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.948190 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.948412 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.948516 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.948725 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.948819 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.949036 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.949663 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.949883 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.949979 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.950166 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.950331 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.950477 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.950580 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.950789 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.950934 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.951104 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.951225 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.951440 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.951776 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.951875 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.952071 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.952289 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.952433 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.952606 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.952910 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.953041 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.953263 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.953369 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.953786 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.953909 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.954040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.954124 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.954271 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.954432 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.954726 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.954827 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.955043 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.955141 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.955354 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.955478 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.955712 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.955833 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.956032 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.956132 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.956346 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.956454 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.956681 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.956790 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.956997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.957103 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.957324 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.957427 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.957644 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.957751 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.957957 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.958053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.958277 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.958373 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.958597 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.958702 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.958913 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.959018 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.959234 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.959483 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.959597 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.959848 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.959952 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.960142 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.960241 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.960463 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.960574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.960785 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.960882 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.961109 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.961326 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.961425 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.961664 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.961772 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.961986 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.962084 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.962306 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.962413 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.962626 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.962731 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.962949 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.963054 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.963270 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.963399 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.963616 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.963716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.963991 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.964113 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.964246 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.964392 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.964556 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.964703 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.965490 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.965677 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.965918 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.966057 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.966191 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.966335 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.966472 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.966607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.966773 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.966913 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.967097 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.967236 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.967443 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.967597 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.967769 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.967934 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.968131 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.968279 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.968455 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.968602 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.968768 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.968913 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.969090 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.969234 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.969407 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.969621 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.969766 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.969915 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.970122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.970268 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.970412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.970545 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.970927 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.971062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.971195 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.971327 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.971512 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.971656 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.971812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.971950 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.972131 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.972270 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.972452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.972590 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.972782 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.973000 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.973138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.973325 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.973463 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.973667 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.973811 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.974095 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.974242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.974386 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.974521 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.974663 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.974866 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.975005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.975188 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.975337 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.975553 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.975851 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.976001 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.976174 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.976314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.976494 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.976641 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.976814 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.976953 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.977131 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.977347 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.977485 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.977628 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.977762 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.977896 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.978036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.978181 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.978341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.978479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.978651 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.978797 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.978982 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.979215 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.979355 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.979605 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.979745 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.979931 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.980071 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.980295 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.980451 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.980734 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.980916 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.981105 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.981368 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.981507 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.981747 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.981891 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.982067 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.982212 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.982385 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.982524 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.982711 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.982850 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.983033 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.983179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.983333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.983504 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.983682 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.983821 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.983996 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.984276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.984424 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.984564 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.984707 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.984877 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.985002 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.985144 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.985280 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.985413 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.985546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.985685 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.985828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.985973 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.986103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.986244 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.986415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.986555 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.986727 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.986875 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.987035 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.987171 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.987348 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.987526 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.987674 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.987819 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.987963 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.988106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.988283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.988433 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.988596 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.988741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.988913 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.989060 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.989224 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.989367 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.989543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.989689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.989855 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.989993 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.990161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.990321 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.990533 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.990711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.990847 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.990979 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.991113 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.991246 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.991422 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.991560 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.991752 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.991889 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.992059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.992211 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.992388 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.992534 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.992700 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.992846 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.993057 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.993206 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.993378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.993524 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.993690 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.993837 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.994104 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.994403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.994550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.994693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.994836 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.994972 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.995114 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.995262 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.995439 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.995576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.995872 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.996029 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.996212 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.996512 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.996651 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.996848 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.996983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.997169 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.997322 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.997493 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.997639 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.997810 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.997947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.998127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.998278 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.998457 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.998605 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.998747 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.998889 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.999062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.999208 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.999394 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.999550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.999700 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:16.999836 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.000016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.000167 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.000332 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.000477 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.000703 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.000848 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.000996 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.001130 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.001270 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.001403 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.001536 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.001682 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.001878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.002023 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.002207 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.002343 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.002523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.002670 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.002840 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.002977 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.003155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.003298 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.003500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.003658 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.003804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.003945 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.004117 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.004263 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.004489 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.004641 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.004766 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.004905 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.005076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.005219 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.005362 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.005497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.005660 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.005808 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.005990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.006130 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.006305 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.006444 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.006626 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.006771 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.006961 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.007176 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.007314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.007498 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.007632 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.007778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.007968 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.008115 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.008288 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.008428 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.008614 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.008759 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.008934 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.009082 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.009225 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.009372 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.009553 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.009726 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.009873 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.010023 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.010166 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.010291 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.010489 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.010640 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.010864 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.011002 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.011145 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.011280 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.011449 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.011592 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.012275 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.012400 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.012596 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.012735 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.012909 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.013048 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.013221 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.013367 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.013538 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.013683 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.013899 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.014056 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.014200 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.014333 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.014483 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.014681 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.014819 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.015006 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.015152 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.015327 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.015507 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.015644 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.015789 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.015958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.016106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.016270 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.016407 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.016576 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.016720 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.016864 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.016997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.017177 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.017323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.017481 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.017631 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.017788 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.017948 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.018205 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.018332 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.018455 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.018584 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.018701 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.018842 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.018987 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.019121 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.019255 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.019417 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.019604 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.019914 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.020058 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.020222 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.020359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.020530 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.020676 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.020894 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.021043 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.021186 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.021335 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.021503 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.021651 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.021830 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.021969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.022147 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.022294 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.022467 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.022612 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.022778 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.022921 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.023103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.023256 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.023502 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.023653 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.023789 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.023930 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.024066 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.024208 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.024380 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.024521 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.024699 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.024841 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.025009 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.025154 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.025323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.025462 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.025636 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.025760 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.025947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.026095 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.026260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.026405 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.026584 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.026721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.026911 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.027056 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.027220 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.027955 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.028246 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.028410 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.028548 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.028690 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.028824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.028967 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.029102 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.029245 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.029411 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.029550 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.029748 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.029887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.030065 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.030215 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.030448 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.030595 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.030738 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.030873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.031098 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.031251 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.031410 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.031560 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.031696 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.031837 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.031981 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.032117 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.032259 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.032401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.032543 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.032678 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.032820 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.032956 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.033150 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.033288 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.033479 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.033634 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.033778 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.033913 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.034106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.034254 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.034440 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.034594 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.034791 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.034936 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.035114 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.035260 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.035438 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.035591 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.035735 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 14:24:17.035866 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.036103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.036421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.036730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 14:24:17.036976 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 14:24:17.098546 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO dbcounter [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] Registered counter for database nova_api Aug 18 14:24:17.099544 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO dbcounter [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] Registered counter for database nova_api Aug 18 14:24:17.120767 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_db.sqlalchemy.engines [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:24:17.122567 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_db.sqlalchemy.engines [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:24:17.127719 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writer thread running {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:24:17.129245 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writer thread running {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:24:17.187952 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.context [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c88e209a-0f4b-4562-a6ce-d78b951fe397(cell1) {{(pid=120538) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 14:24:17.188087 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.context [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c88e209a-0f4b-4562-a6ce-d78b951fe397(cell1) {{(pid=120539) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 14:24:17.192509 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:24:17.192991 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:24:17.193592 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:24:17.194076 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:24:17.194573 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:24:17.195321 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:24:17.195797 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:24:17.195919 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:24:17.196902 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:24:17.197586 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:24:17.197792 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:24:17.200825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO dbcounter [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] Registered counter for database nova_cell0 Aug 18 14:24:17.201167 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:24:17.203361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO dbcounter [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] Registered counter for database nova_cell0 Aug 18 14:24:17.204969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO dbcounter [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] Registered counter for database nova_cell1 Aug 18 14:24:17.208424 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO dbcounter [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] Registered counter for database nova_cell1 Aug 18 14:24:17.213001 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_db.sqlalchemy.engines [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:24:17.214294 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_db.sqlalchemy.engines [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:24:17.217198 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_db.sqlalchemy.engines [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:24:17.220148 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_db.sqlalchemy.engines [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:24:17.223787 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writer thread running {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:24:17.225405 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writer thread running {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:24:17.227260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writer thread running {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:24:17.229402 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writer thread running {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:24:17.375343 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO dbcounter [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] Registered counter for database nova_cell0 Aug 18 14:24:17.382143 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO dbcounter [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] Registered counter for database nova_cell0 Aug 18 14:24:17.382354 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_db.sqlalchemy.engines [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:24:17.391203 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_db.sqlalchemy.engines [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 14:24:17.392373 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writer thread running {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:24:17.398590 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writer thread running {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 14:24:17.714882 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: WARNING keystonemiddleware.auth_token [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:24:17.722407 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: WARNING keystonemiddleware.auth_token [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:24:17.725041 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: WARNING keystonemiddleware.auth_token [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:24:17.733190 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: WARNING keystonemiddleware.auth_token [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:24:18.072931 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: WARNING keystonemiddleware.auth_token [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:24:18.079619 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: WARNING keystonemiddleware.auth_token [None req-3541812e-eed9-4ef9-add8-aa4dbea65f61 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:24:18.084893 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598ecb969c0 pid: 120538 (default app) Aug 18 14:24:18.093736 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: WARNING keystonemiddleware.auth_token [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 14:24:18.100229 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: WARNING keystonemiddleware.auth_token [None req-68de2162-6a56-440b-a3a7-a8b537c22216 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 14:24:18.105551 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598ecb969c0 pid: 120539 (default app) Aug 18 14:24:52.341248 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:24:52.342134 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:24:52.342916 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:24:52.344478 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:24:53.452762 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d46c3170-7735-412e-81c4-ac51ca7c663d tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Action: 'create', calling method: .version_select at 0x7fb6240334c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1806292315"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:24:56.068094 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d46c3170-7735-412e-81c4-ac51ca7c663d tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.736639 Aug 18 14:24:56.079082 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1155 bytes} [Thu Aug 18 14:24:52 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3750 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 14:24:56.086040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:24:56.087518 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:24:56.089274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:24:56.092733 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:24:56.095953 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eedf1679-d0b4-4973-b494-fe2f121832c8 tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] Calling method '.version_select at 0x7fb623f073a0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:24:56.153342 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eedf1679-d0b4-4973-b494-fe2f121832c8 tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/50cc8473-c6ae-441f-b188-9781a391832f" status: 200 len: 351 microversion: 2.1 time: 0.071728 Aug 18 14:24:56.169508 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2/2] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Aug 18 14:24:56 2022] GET /compute/v2.1/os-volumes/50cc8473-c6ae-441f-b188-9781a391832f => generated 351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:24:56.602043 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-53e9887a-0e43-41d5-a1ec-0a30e58dc6d4 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb62407f3a0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:24:57.229093 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-53e9887a-0e43-41d5-a1ec-0a30e58dc6d4 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df" status: 200 len: 346 microversion: 2.1 time: 1.147148 Aug 18 14:24:57.230813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1/3] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Aug 18 14:24:56 2022] GET /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df => generated 346 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:24:57.255730 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-624b1190-860e-49ae-9321-2eb4120521b3 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Action: 'create', calling method: .version_select at 0x7fb623f07a60>, body: {"snapshot": {"volume_id": "02b54845-239d-45d0-8a91-02837b7e94df", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1035350275"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:24:57.819896 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-624b1190-860e-49ae-9321-2eb4120521b3 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.579237 Aug 18 14:24:57.822498 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 3/4] 10.222.0.39 () {60 vars in 1162 bytes} [Thu Aug 18 14:24:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:24:57.843347 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6a86619a-ea67-4401-b070-a6734a2b738d tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb623f473a0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:24:58.012540 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7993d61c-f959-4547-bb6b-71d2f66dbad4 tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] Calling method '.version_select at 0x7fb623f1eb80>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:24:58.048515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6a86619a-ea67-4401-b070-a6734a2b738d tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8" status: 200 len: 287 microversion: 2.1 time: 0.214849 Aug 18 14:24:58.056147 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2/5] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Aug 18 14:24:57 2022] GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8 => generated 287 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:24:58.061411 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ff9b8335-1739-466b-82de-0ef9850bc6f6 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb623f47a60>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:24:58.236984 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7993d61c-f959-4547-bb6b-71d2f66dbad4 tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/cee69319-8018-416a-b7aa-c467d49c96b5" status: 200 len: 350 microversion: 2.1 time: 0.228503 Aug 18 14:24:58.237683 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 4/6] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Aug 18 14:24:58 2022] GET /compute/v2.1/os-volumes/cee69319-8018-416a-b7aa-c467d49c96b5 => generated 350 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:24:58.295666 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ff9b8335-1739-466b-82de-0ef9850bc6f6 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.237588 Aug 18 14:24:58.303166 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 3/7] 10.222.0.39 () {58 vars in 1140 bytes} [Thu Aug 18 14:24:58 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:24:58.307072 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-84d245f3-4a48-48bf-bdb4-e8677c1e2625 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb623f07e50>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:24:58.513125 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-84d245f3-4a48-48bf-bdb4-e8677c1e2625 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8" status: 200 len: 287 microversion: 2.1 time: 0.209372 Aug 18 14:24:58.514314 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 5/8] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Aug 18 14:24:58 2022] GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8 => generated 287 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:24:59.534110 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f32e851b-257d-4478-acff-1d16cdb1853e tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb623f47820>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:24:59.650494 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f32e851b-257d-4478-acff-1d16cdb1853e tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8" status: 200 len: 287 microversion: 2.1 time: 0.122966 Aug 18 14:24:59.652235 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 4/9] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Aug 18 14:24:59 2022] GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8 => generated 287 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:00.668814 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e191162d-3e97-48ab-9bcf-2834199ed72e tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb623f074c0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:00.735128 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e191162d-3e97-48ab-9bcf-2834199ed72e tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8" status: 200 len: 287 microversion: 2.1 time: 0.074628 Aug 18 14:25:00.736555 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 6/10] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Aug 18 14:25:00 2022] GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:01.752334 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aee14c93-f61e-4c1e-8251-5de83edaba94 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb623ef9940>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:01.837892 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aee14c93-f61e-4c1e-8251-5de83edaba94 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8" status: 200 len: 288 microversion: 2.1 time: 0.082391 Aug 18 14:25:01.839985 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 5/11] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Aug 18 14:25:01 2022] GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8 => generated 288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:01.854538 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-36503d03-3c59-4029-b425-bac15d709a6f tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb623f1edc0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:02.045273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-36503d03-3c59-4029-b425-bac15d709a6f tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8" status: 202 len: 0 microversion: 2.1 time: 0.195035 Aug 18 14:25:02.045856 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 7/12] 10.222.0.39 () {58 vars in 1254 bytes} [Thu Aug 18 14:25:01 2022] DELETE /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:25:02.056082 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-36103fa5-2853-4710-9016-09b4fa1d1e0f tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb6248de700>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:02.090911 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-36103fa5-2853-4710-9016-09b4fa1d1e0f tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8" status: 200 len: 287 microversion: 2.1 time: 0.040325 Aug 18 14:25:02.091683 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 6/13] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Aug 18 14:25:02 2022] GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:02.491921 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3af2e188-444f-4c50-bdd6-935c3291a4fa tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] Calling method '.version_select at 0x7fb623f075e0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:02.613991 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3af2e188-444f-4c50-bdd6-935c3291a4fa tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7ea5fb7e-ef3c-40a8-aba3-78a60afca8ea" status: 200 len: 351 microversion: 2.1 time: 0.126320 Aug 18 14:25:02.614929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 8/14] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Aug 18 14:25:02 2022] GET /compute/v2.1/os-volumes/7ea5fb7e-ef3c-40a8-aba3-78a60afca8ea => generated 351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:02.627768 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-312b6ac8-0e13-4b95-a69e-91b8f614c742 tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] Calling method '.version_select at 0x7fb624167160>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:02.818777 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-312b6ac8-0e13-4b95-a69e-91b8f614c742 tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.194926 Aug 18 14:25:02.820232 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 7/15] 10.222.0.39 () {58 vars in 1134 bytes} [Thu Aug 18 14:25:02 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:02.835173 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-90918636-dab6-4ad2-996a-3fff75a7b1b5 tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] Calling method '.version_select at 0x7fb623f07dc0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:03.103569 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d148e73c-5318-4026-bb34-23d705961d88 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb623f1c8b0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:03.126510 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-90918636-dab6-4ad2-996a-3fff75a7b1b5 tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.295045 Aug 18 14:25:03.127683 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 9/16] 10.222.0.39 () {58 vars in 1149 bytes} [Thu Aug 18 14:25:02 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:03.139100 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-d148e73c-5318-4026-bb34-23d705961d88 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] HTTP exception thrown: Snapshot 7ad28829-0b68-4612-8be9-a39672eeefd8 could not be found. Aug 18 14:25:03.141173 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a647e557-c453-4b7d-80b7-a4c88c9a60ee tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] Calling method '.version_select at 0x7fb623f1e3a0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d148e73c-5318-4026-bb34-23d705961d88 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Request method failure captured: Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8 HTTP/1.1 Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_ku0iS0o824uPkCOC1JzjkBJvyDY_iHPio8109LM710TXs9ruWh4HywFzXlrR4YBh-FM5Tkow1p1xhf2dSevbCJQv8DAsHSHUxcUOVJMtGGC2srruUa0BmKO6JZi62nbNF86PxlJmbbRUhh8D2vondn3m_hI0hF5bOSeatYH2kJACxI Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 34bceddc1c6040919261d74b3877beb2 Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1307477984 Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:25:03.143158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:25:03.144338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/34bceddc1c6040919261d74b3877beb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_34bceddc1c6040919261d74b3877beb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/34bceddc1c6040919261d74b3877beb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/34bceddc1c6040919261d74b3877beb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:25:03.144338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1307477984 Aug 18 14:25:03.144338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 34bceddc1c6040919261d74b3877beb2 Aug 18 14:25:03.144338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1307477984 Aug 18 14:25:03.144338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesSnapshotsTestJSON-1307477984-project Aug 18 14:25:03.144338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:25:03.144338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:25:03.144338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 7047e2f8fab54e7c879f62df3db23f58 Aug 18 14:25:03.144338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1307477984-project Aug 18 14:25:03.144338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: Aug 18 14:25:03.144338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Snapshot 7ad28829-0b68-4612-8be9-a39672eeefd8 could not be found. Aug 18 14:25:03.144338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '7ad28829-0b68-4612-8be9-a39672eeefd8'} Aug 18 14:25:03.144338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7ad28829-0b68-4612-8be9-a39672eeefd8 could not be found. (HTTP 404) (Request-ID: req-7a9701ac-bdef-4aaf-9e94-d8e2dd06c455) Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:03.145161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:25:03.146103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7ad28829-0b68-4612-8be9-a39672eeefd8 could not be found. Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 18 14:25:03.147014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:25:03.151282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7ad28829-0b68-4612-8be9-a39672eeefd8 could not be found. Aug 18 14:25:03.151282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:03.151282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:03.151282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:03.151282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:03.151282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:03.151282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:03.151282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:25:03.151282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:25:03.151282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7ad28829-0b68-4612-8be9-a39672eeefd8 could not be found. Aug 18 14:25:03.151282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:03.151282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d148e73c-5318-4026-bb34-23d705961d88 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Returning 404 to user: Snapshot 7ad28829-0b68-4612-8be9-a39672eeefd8 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:25:03.151282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d148e73c-5318-4026-bb34-23d705961d88 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8" status: 404 len: 111 microversion: 2.1 time: 0.044908 Aug 18 14:25:03.153365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 8/17] 10.222.0.39 () {58 vars in 1251 bytes} [Thu Aug 18 14:25:03 2022] GET /compute/v2.1/os-snapshots/7ad28829-0b68-4612-8be9-a39672eeefd8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:25:03.157097 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-550b1b4e-f9cc-445c-9c17-d2ff3f40b2e3 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb623f47f70>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:03.294070 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-550b1b4e-f9cc-445c-9c17-d2ff3f40b2e3 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df" status: 202 len: 0 microversion: 2.1 time: 0.140571 Aug 18 14:25:03.295022 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 9/18] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Aug 18 14:25:03 2022] DELETE /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:25:03.303398 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6616af9c-e633-4903-afd3-1b1d433d6d91 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb623f47ee0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:03.410296 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a647e557-c453-4b7d-80b7-a4c88c9a60ee tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.273241 Aug 18 14:25:03.411531 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 10/19] 10.222.0.39 () {58 vars in 1134 bytes} [Thu Aug 18 14:25:03 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:03.424788 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6616af9c-e633-4903-afd3-1b1d433d6d91 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df" status: 200 len: 345 microversion: 2.1 time: 0.125221 Aug 18 14:25:03.425725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 10/20] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Aug 18 14:25:03 2022] GET /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:03.426179 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-51bb4dc2-8ff5-41d3-8de9-68b159c22f90 tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] Calling method '.version_select at 0x7fb623f1e820>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:03.740421 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-51bb4dc2-8ff5-41d3-8de9-68b159c22f90 tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.319734 Aug 18 14:25:03.741022 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 11/21] 10.222.0.39 () {58 vars in 1167 bytes} [Thu Aug 18 14:25:03 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:03.756530 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4a31d807-8514-4da0-8836-6457eca80b9c tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] Calling method '.version_select at 0x7fb623f475e0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:03.916588 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4a31d807-8514-4da0-8836-6457eca80b9c tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.164649 Aug 18 14:25:03.918276 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 11/22] 10.222.0.39 () {58 vars in 1170 bytes} [Thu Aug 18 14:25:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:25:03.934697 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b8cfcd4c-4db0-42d8-9ca8-4ed755d7db8d tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] Calling method '.version_select at 0x7fb623f2b550>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:04.118497 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b8cfcd4c-4db0-42d8-9ca8-4ed755d7db8d tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.190162 Aug 18 14:25:04.119797 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1155 bytes} [Thu Aug 18 14:25:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:04.133771 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6e30dc82-5a51-40e6-b752-d1a3489ae6b2 tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] Calling method '.version_select at 0x7fb623f1cf70>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:04.279908 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6e30dc82-5a51-40e6-b752-d1a3489ae6b2 tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.150863 Aug 18 14:25:04.282061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 12/24] 10.222.0.39 () {58 vars in 1188 bytes} [Thu Aug 18 14:25:04 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:04.296628 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ed8bd170-45a5-4ceb-ac2d-d60f6961e3aa tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] Calling method '.version_select at 0x7fb623f2c790>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:04.440389 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bff00f31-8612-4d09-afad-eb765f8f9dc0 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb623f1c0d0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:04.446478 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ed8bd170-45a5-4ceb-ac2d-d60f6961e3aa tempest-VolumesTestJSON-1890026564 tempest-VolumesTestJSON-1890026564-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.155287 Aug 18 14:25:04.448267 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 13/25] 10.222.0.39 () {58 vars in 1155 bytes} [Thu Aug 18 14:25:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:04.505287 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-bff00f31-8612-4d09-afad-eb765f8f9dc0 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] HTTP exception thrown: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bff00f31-8612-4d09-afad-eb765f8f9dc0 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Request method failure captured: Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df HTTP/1.1 Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_ku0iS0o824uPkCOC1JzjkBJvyDY_iHPio8109LM710TXs9ruWh4HywFzXlrR4YBh-FM5Tkow1p1xhf2dSevbCJQv8DAsHSHUxcUOVJMtGGC2srruUa0BmKO6JZi62nbNF86PxlJmbbRUhh8D2vondn3m_hI0hF5bOSeatYH2kJACxI Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 34bceddc1c6040919261d74b3877beb2 Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1307477984 Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:25:04.507670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:25:04.508941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/34bceddc1c6040919261d74b3877beb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_34bceddc1c6040919261d74b3877beb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/34bceddc1c6040919261d74b3877beb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/34bceddc1c6040919261d74b3877beb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:25:04.508941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1307477984 Aug 18 14:25:04.508941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 34bceddc1c6040919261d74b3877beb2 Aug 18 14:25:04.508941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1307477984 Aug 18 14:25:04.508941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesSnapshotsTestJSON-1307477984-project Aug 18 14:25:04.508941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:25:04.508941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:25:04.508941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 7047e2f8fab54e7c879f62df3db23f58 Aug 18 14:25:04.508941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1307477984-project Aug 18 14:25:04.508941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: Aug 18 14:25:04.508941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.508941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '02b54845-239d-45d0-8a91-02837b7e94df'} Aug 18 14:25:04.508941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. (HTTP 404) (Request-ID: req-8b633a1b-99d6-4532-bff6-7064e156b90c) Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:04.509721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:25:04.511106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 14:25:04.512344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bff00f31-8612-4d09-afad-eb765f8f9dc0 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Returning 404 to user: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bff00f31-8612-4d09-afad-eb765f8f9dc0 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df" status: 404 len: 109 microversion: 2.1 time: 0.073672 Aug 18 14:25:04.513456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 13/26] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Aug 18 14:25:04 2022] GET /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:25:04.522294 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cc04ae1f-d3bb-4e5a-86a9-d70e62f77503 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb623f2b5e0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:04.612180 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-cc04ae1f-d3bb-4e5a-86a9-d70e62f77503 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] HTTP exception thrown: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cc04ae1f-d3bb-4e5a-86a9-d70e62f77503 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Request method failure captured: Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df HTTP/1.1 Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_ku0iS0o824uPkCOC1JzjkBJvyDY_iHPio8109LM710TXs9ruWh4HywFzXlrR4YBh-FM5Tkow1p1xhf2dSevbCJQv8DAsHSHUxcUOVJMtGGC2srruUa0BmKO6JZi62nbNF86PxlJmbbRUhh8D2vondn3m_hI0hF5bOSeatYH2kJACxI Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 34bceddc1c6040919261d74b3877beb2 Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1307477984 Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:25:04.618563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:25:04.620420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/34bceddc1c6040919261d74b3877beb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_34bceddc1c6040919261d74b3877beb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/34bceddc1c6040919261d74b3877beb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/34bceddc1c6040919261d74b3877beb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:25:04.620420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1307477984 Aug 18 14:25:04.620420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 34bceddc1c6040919261d74b3877beb2 Aug 18 14:25:04.620420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1307477984 Aug 18 14:25:04.620420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesSnapshotsTestJSON-1307477984-project Aug 18 14:25:04.620420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:25:04.620420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:25:04.620420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 7047e2f8fab54e7c879f62df3db23f58 Aug 18 14:25:04.620420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1307477984-project Aug 18 14:25:04.620420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: Aug 18 14:25:04.620420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.620420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '02b54845-239d-45d0-8a91-02837b7e94df'} Aug 18 14:25:04.620420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. (HTTP 404) (Request-ID: req-13f2bc4e-d865-44da-a026-c10cf4da998e) Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:04.621096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 14:25:04.622016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 14:25:04.623032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:25:04.624005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.624005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.624005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:04.624005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.624005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:04.624005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:04.624005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:04.624005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:25:04.624005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:25:04.624005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.624005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.626576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cc04ae1f-d3bb-4e5a-86a9-d70e62f77503 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Returning 404 to user: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:25:04.627750 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cc04ae1f-d3bb-4e5a-86a9-d70e62f77503 tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df" status: 404 len: 109 microversion: 2.1 time: 0.109646 Aug 18 14:25:04.628593 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 14/27] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Aug 18 14:25:04 2022] DELETE /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:25:04.639234 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2c1fa1b1-80b8-416e-afa7-bd5ac0123b3e tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Calling method '.version_select at 0x7fb623f475e0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:04.692639 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-2c1fa1b1-80b8-416e-afa7-bd5ac0123b3e tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] HTTP exception thrown: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2c1fa1b1-80b8-416e-afa7-bd5ac0123b3e tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Request method failure captured: Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df HTTP/1.1 Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_ku0iS0o824uPkCOC1JzjkBJvyDY_iHPio8109LM710TXs9ruWh4HywFzXlrR4YBh-FM5Tkow1p1xhf2dSevbCJQv8DAsHSHUxcUOVJMtGGC2srruUa0BmKO6JZi62nbNF86PxlJmbbRUhh8D2vondn3m_hI0hF5bOSeatYH2kJACxI Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 34bceddc1c6040919261d74b3877beb2 Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1307477984 Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:25:04.695138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:25:04.696415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/34bceddc1c6040919261d74b3877beb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_34bceddc1c6040919261d74b3877beb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/34bceddc1c6040919261d74b3877beb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/34bceddc1c6040919261d74b3877beb2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:25:04.696415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1307477984 Aug 18 14:25:04.696415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 34bceddc1c6040919261d74b3877beb2 Aug 18 14:25:04.696415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1307477984 Aug 18 14:25:04.696415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesSnapshotsTestJSON-1307477984-project Aug 18 14:25:04.696415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:25:04.696415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:25:04.696415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 7047e2f8fab54e7c879f62df3db23f58 Aug 18 14:25:04.696415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1307477984-project Aug 18 14:25:04.696415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: Aug 18 14:25:04.696415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.696415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '02b54845-239d-45d0-8a91-02837b7e94df'} Aug 18 14:25:04.696415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. (HTTP 404) (Request-ID: req-952ae35d-b80a-45b5-8654-f2e7bb388aae) Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:04.697085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:25:04.698179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 14:25:04.699404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2c1fa1b1-80b8-416e-afa7-bd5ac0123b3e tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] Returning 404 to user: Volume 02b54845-239d-45d0-8a91-02837b7e94df could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2c1fa1b1-80b8-416e-afa7-bd5ac0123b3e tempest-VolumesSnapshotsTestJSON-1307477984 tempest-VolumesSnapshotsTestJSON-1307477984-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df" status: 404 len: 109 microversion: 2.1 time: 0.063409 Aug 18 14:25:04.700390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 14/28] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Aug 18 14:25:04 2022] GET /compute/v2.1/os-volumes/02b54845-239d-45d0-8a91-02837b7e94df => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:25:06.952377 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-802241347", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "networks": [{"uuid": "7f053155-7a3e-4e4b-839d-01e336f6eb7e"}]}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:07.144239 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] validate_networks() for [('7f053155-7a3e-4e4b-839d-01e336f6eb7e', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:25:08.395237 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-400393002", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:08.566611 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] validate_networks() for [('93a3f080-9f42-4a42-bbe6-3276be1407f3', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:25:09.851942 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:25:09.852954 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:25:09.854208 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:25:09.855132 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:25:09.855817 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:25:09.890383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:09.890863 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:09.891489 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:09.892601 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:09.893206 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:09.893783 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:09.974830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Getting quotas for project 8637cffaecaf4fd58439bf1362d1bdd5. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:25:09.983322 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Getting quotas for user 4c875db4d43e47f986d5a9168813ed95 and project 8637cffaecaf4fd58439bf1362d1bdd5. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:25:10.012056 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:25:10.016368 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:25:10.152949 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7ec9c9a7-25d8-4344-b776-69d44b842f64 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.804311 Aug 18 14:25:10.154474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 15/29] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:25:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:25:10.954398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f917a4db-05d0-478e-9169-435e8439ef27 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Action: 'create', calling method: .version_select at 0x7fb623598040>, body: {"keypair": {"name": "tempest-keypair-1128760775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEYys7Y/hWaTCiqsg+sKulM+M9l6JoF4IGBeWpH1lkgBEclYyYxPwG1YbJz0diiFcUIEo6G+f5FFdfasl/oh9EUC4ALocYkLp5aiE3GH8GuRzwR+Rw2r16Wb4/94aeR4Q=="}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:11.011963 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-f917a4db-05d0-478e-9169-435e8439ef27 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:25:11.023601 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-f917a4db-05d0-478e-9169-435e8439ef27 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for user 5972d1e96fa04d52983ac6f201d7772c and project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:25:11.061748 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:25:11.062221 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:25:11.062675 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:25:11.063235 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:25:11.063688 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:25:11.091973 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:11.092705 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:11.093329 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:11.094406 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:11.095012 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:11.095896 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:11.096034 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f917a4db-05d0-478e-9169-435e8439ef27 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.939317 Aug 18 14:25:11.097625 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 16/30] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Aug 18 14:25:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:11.111167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3b8cabcd-bdfb-4113-aef8-68db5582d769 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:11.112117 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3b8cabcd-bdfb-4113-aef8-68db5582d769 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:11.179764 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Getting quotas for project e39a8bb94bfb417b951e4f66473fa900. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:25:11.196216 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Getting quotas for user 12e95dabd6f04cd9818a77f27b34d927 and project e39a8bb94bfb417b951e4f66473fa900. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:25:11.229414 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:25:11.234169 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:25:11.361044 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3b8cabcd-bdfb-4113-aef8-68db5582d769 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:11.412366 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3b8cabcd-bdfb-4113-aef8-68db5582d769 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1214 microversion: 2.1 time: 0.311735 Aug 18 14:25:11.429479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 17/31] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:11 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1214 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:11.454055 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a0b808a3-e9fc-4c62-bb53-c7253a3a23f8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.725466 Aug 18 14:25:11.454828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 15/32] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:25:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 3727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:25:11.472913 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-258bc325-95aa-4d40-89d5-67a1e445fc19 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:11.473577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-258bc325-95aa-4d40-89d5-67a1e445fc19 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:11.559186 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-258bc325-95aa-4d40-89d5-67a1e445fc19 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:11.566928 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-258bc325-95aa-4d40-89d5-67a1e445fc19 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1221 microversion: 2.1 time: 0.103942 Aug 18 14:25:11.568432 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 18/33] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:11 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:12.174092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-59307643", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:12.260735 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] validate_networks() for [('93a3f080-9f42-4a42-bbe6-3276be1407f3', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:25:12.437882 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9712e965-a7c7-401c-98ba-81272c7c79a6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:12.438633 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9712e965-a7c7-401c-98ba-81272c7c79a6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:12.932431 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9712e965-a7c7-401c-98ba-81272c7c79a6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:12.956256 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9712e965-a7c7-401c-98ba-81272c7c79a6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1214 microversion: 2.1 time: 0.522549 Aug 18 14:25:12.993498 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 19/34] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:12 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1214 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:13.568644 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:25:13.569103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:25:13.569534 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:25:13.569944 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:25:13.570359 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:25:13.590600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:13.593404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:13.594047 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:13.597684 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:13.598337 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:13.599042 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:13.662599 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Getting quotas for project e39a8bb94bfb417b951e4f66473fa900. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:25:13.677491 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Getting quotas for user 12e95dabd6f04cd9818a77f27b34d927 and project e39a8bb94bfb417b951e4f66473fa900. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:25:13.713355 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:25:13.721729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:25:13.862418 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-88904e1d-f9e5-4d8c-bf4b-65372e65d57f tempest-VolumesGetTestJSON-340541942 tempest-VolumesGetTestJSON-340541942-project] Action: 'create', calling method: .version_select at 0x7fb62254d820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-328319623", "metadata": {"Type": "work"}}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:13.874084 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-71bc4af8-923f-45d9-999d-eb56e371ae82 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.699119 Aug 18 14:25:13.875173 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 16/35] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:25:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:25:13.887262 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5279c349-a97f-45af-9cb3-4b05374d6888 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:13.893345 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5279c349-a97f-45af-9cb3-4b05374d6888 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:14.251936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5279c349-a97f-45af-9cb3-4b05374d6888 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:14.278238 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5279c349-a97f-45af-9cb3-4b05374d6888 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1220 microversion: 2.1 time: 0.394037 Aug 18 14:25:14.281251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 17/36] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:13 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1220 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:25:14.296212 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e3bee231-17ca-4261-8e1c-aab3b4eb7192 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:14.297184 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e3bee231-17ca-4261-8e1c-aab3b4eb7192 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:14.420713 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e3bee231-17ca-4261-8e1c-aab3b4eb7192 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:14.440287 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e3bee231-17ca-4261-8e1c-aab3b4eb7192 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1214 microversion: 2.1 time: 0.157058 Aug 18 14:25:14.441531 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 18/37] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:14 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:14.487141 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-488352242", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce7c320a-581c-4aa3-85bd-1646d1f4ed3c"}], "security_groups": [{"name": "tempest-securitygroup--1465254291"}], "key_name": "tempest-keypair-1128760775", "user_data": "}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:14.772383 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] validate_networks() for [('ce7c320a-581c-4aa3-85bd-1646d1f4ed3c', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:25:15.100421 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-88904e1d-f9e5-4d8c-bf4b-65372e65d57f tempest-VolumesGetTestJSON-340541942 tempest-VolumesGetTestJSON-340541942-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.101958 Aug 18 14:25:15.101331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 20/38] 10.222.0.39 () {60 vars in 1156 bytes} [Thu Aug 18 14:25:12 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2107 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 14:25:15.114071 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c7784c50-d54f-4237-8895-2a8d52b77d9b tempest-VolumesGetTestJSON-340541942 tempest-VolumesGetTestJSON-340541942-project] Calling method '.version_select at 0x7fb6225698b0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:15.357914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c7784c50-d54f-4237-8895-2a8d52b77d9b tempest-VolumesGetTestJSON-340541942 tempest-VolumesGetTestJSON-340541942-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/907088a8-ac12-40f7-ae08-ff8ad05bc6cf" status: 200 len: 353 microversion: 2.1 time: 0.246734 Aug 18 14:25:15.358572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 21/39] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Aug 18 14:25:15 2022] GET /compute/v2.1/os-volumes/907088a8-ac12-40f7-ae08-ff8ad05bc6cf => generated 353 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:25:15.364069 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7302eaf1-c78b-461c-bae9-e3a6a72594ca tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:15.364684 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7302eaf1-c78b-461c-bae9-e3a6a72594ca tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:15.396272 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7302eaf1-c78b-461c-bae9-e3a6a72594ca tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:15.398198 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7302eaf1-c78b-461c-bae9-e3a6a72594ca tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:15.398853 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7302eaf1-c78b-461c-bae9-e3a6a72594ca tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:15.401620 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7302eaf1-c78b-461c-bae9-e3a6a72594ca tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:15.402430 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7302eaf1-c78b-461c-bae9-e3a6a72594ca tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:15.406469 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7302eaf1-c78b-461c-bae9-e3a6a72594ca tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:15.570240 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7302eaf1-c78b-461c-bae9-e3a6a72594ca tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:15.613005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7302eaf1-c78b-461c-bae9-e3a6a72594ca tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1216 microversion: 2.1 time: 0.250217 Aug 18 14:25:15.614013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 22/40] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:15 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1216 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:15.624081 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e64025cd-7f5a-4e4d-9e61-0a4310844b9d tempest-VolumesGetTestJSON-340541942 tempest-VolumesGetTestJSON-340541942-project] Calling method '.version_select at 0x7fb62246e700>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:15.856763 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e64025cd-7f5a-4e4d-9e61-0a4310844b9d tempest-VolumesGetTestJSON-340541942 tempest-VolumesGetTestJSON-340541942-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/907088a8-ac12-40f7-ae08-ff8ad05bc6cf" status: 200 len: 353 microversion: 2.1 time: 0.241116 Aug 18 14:25:15.857346 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 23/41] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Aug 18 14:25:15 2022] GET /compute/v2.1/os-volumes/907088a8-ac12-40f7-ae08-ff8ad05bc6cf => generated 353 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:15.920725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:25:15.922182 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:25:15.922985 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:25:15.923590 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:25:15.937533 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:25:15.968646 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:15.969121 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:15.969570 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:15.973302 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:15.973786 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:15.974221 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:16.023963 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:25:16.037977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for user 5972d1e96fa04d52983ac6f201d7772c and project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:25:16.065192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:25:16.067922 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:25:16.070826 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9eb3d232-ae46-4872-922f-c73a40ad7853 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Action: 'create', calling method: .version_select at 0x7fb62246edc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1658361778", "metadata": {"Type": "work"}}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9eb3d232-ae46-4872-922f-c73a40ad7853 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Request method failure captured: Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 122 Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvL-klv2E4AE64SA13RAOH3sZPFVJYhwmDosw8aAkjyaqn5CmJzt1nKH1mx4GRaXirLmN4pVATASyrqqd2vLbmbS8Ojt00ojPN4UGAkUxsnyR44i0wYjHlggQl7jBVPFyGBgfhFkg4ffP9D6Whpx7FQEPTSLtdppLUZZk88qkPVd74 Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 9e9496e411b64f098958c9e3dc12dc9f Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:25:16.077235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:25:16.078434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:25:16.078434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.078434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 9e9496e411b64f098958c9e3dc12dc9f Aug 18 14:25:16.078434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.078434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesNegativeTest-1267506602-project Aug 18 14:25:16.078434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:25:16.078434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:25:16.078434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 016068e01096440690f7bb64b231ed3a Aug 18 14:25:16.078434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesNegativeTest-1267506602-project Aug 18 14:25:16.078434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Aug 18 14:25:16.078434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1658361778", "metadata": {"Type": "work"}}} Aug 18 14:25:16.078434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: Aug 18 14:25:16.078434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1658361778', 'metadata': {'Type': 'work'}}}} Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise error Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi '#$%' Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:25:16.079189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 14:25:16.080398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 14:25:16.081355 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 14:25:16.081355 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.081355 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9eb3d232-ae46-4872-922f-c73a40ad7853 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:25:16.082309 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9eb3d232-ae46-4872-922f-c73a40ad7853 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.223992 Aug 18 14:25:16.082916 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 24/42] 10.222.0.39 () {60 vars in 1156 bytes} [Thu Aug 18 14:25:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 225 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:25:16.100958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-717da188-1147-404a-b40a-7c9039ae117b tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:16.101668 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-717da188-1147-404a-b40a-7c9039ae117b tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:16.117086 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-717da188-1147-404a-b40a-7c9039ae117b tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:16.117586 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-717da188-1147-404a-b40a-7c9039ae117b tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:16.118029 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-717da188-1147-404a-b40a-7c9039ae117b tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:16.118775 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-717da188-1147-404a-b40a-7c9039ae117b tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:16.123913 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-717da188-1147-404a-b40a-7c9039ae117b tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:16.124403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-717da188-1147-404a-b40a-7c9039ae117b tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:16.141820 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-18b39c0c-93c5-4ec5-8c59-39ac7bff9735 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.687965 Aug 18 14:25:16.146489 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 19/43] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:25:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:25:16.186180 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-97c181fd-196c-4645-a199-8ee4e3f92a07 tempest-VolumesGetTestJSON-340541942 tempest-VolumesGetTestJSON-340541942-project] Calling method '.version_select at 0x7fb622d44b80>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:16.268838 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-717da188-1147-404a-b40a-7c9039ae117b tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:16.281627 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-717da188-1147-404a-b40a-7c9039ae117b tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1274 microversion: 2.1 time: 0.189440 Aug 18 14:25:16.284253 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 25/44] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:16 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1274 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:16.287843 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-97c181fd-196c-4645-a199-8ee4e3f92a07 tempest-VolumesGetTestJSON-340541942 tempest-VolumesGetTestJSON-340541942-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/907088a8-ac12-40f7-ae08-ff8ad05bc6cf" status: 202 len: 0 microversion: 2.1 time: 0.139496 Aug 18 14:25:16.294073 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 20/45] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Aug 18 14:25:16 2022] DELETE /compute/v2.1/os-volumes/907088a8-ac12-40f7-ae08-ff8ad05bc6cf => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:25:16.298129 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-02ba41ef-66ab-4ebb-8cd2-3f0a8e0a7eee tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Action: 'create', calling method: .version_select at 0x7fb622493e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1447032688", "metadata": {"Type": "work"}}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-02ba41ef-66ab-4ebb-8cd2-3f0a8e0a7eee tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Request method failure captured: Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 120 Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvL-klv2E4AE64SA13RAOH3sZPFVJYhwmDosw8aAkjyaqn5CmJzt1nKH1mx4GRaXirLmN4pVATASyrqqd2vLbmbS8Ojt00ojPN4UGAkUxsnyR44i0wYjHlggQl7jBVPFyGBgfhFkg4ffP9D6Whpx7FQEPTSLtdppLUZZk88qkPVd74 Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 9e9496e411b64f098958c9e3dc12dc9f Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:25:16.301877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:25:16.302988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:25:16.302988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.302988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 9e9496e411b64f098958c9e3dc12dc9f Aug 18 14:25:16.302988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.302988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesNegativeTest-1267506602-project Aug 18 14:25:16.302988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:25:16.302988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:25:16.302988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 016068e01096440690f7bb64b231ed3a Aug 18 14:25:16.302988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesNegativeTest-1267506602-project Aug 18 14:25:16.302988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Aug 18 14:25:16.302988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1447032688", "metadata": {"Type": "work"}}} Aug 18 14:25:16.302988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: Aug 18 14:25:16.302988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1447032688', 'metadata': {'Type': 'work'}}}} Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise error Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi '0' Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:25:16.304708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 14:25:16.305825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 14:25:16.307883 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 14:25:16.307883 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.308082 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-147a9889-0eb6-49ec-92e6-4796112c4f08 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:16.308082 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-147a9889-0eb6-49ec-92e6-4796112c4f08 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:16.316333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-02ba41ef-66ab-4ebb-8cd2-3f0a8e0a7eee tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:25:16.325696 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-02ba41ef-66ab-4ebb-8cd2-3f0a8e0a7eee tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.030801 Aug 18 14:25:16.331636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 26/46] 10.222.0.39 () {60 vars in 1156 bytes} [Thu Aug 18 14:25:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:25:16.346340 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e10dd123-2d10-4c8b-a4c4-88285f4e9fb6 tempest-VolumesGetTestJSON-340541942 tempest-VolumesGetTestJSON-340541942-project] Calling method '.version_select at 0x7fb62246b700>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:16.522529 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-e10dd123-2d10-4c8b-a4c4-88285f4e9fb6 tempest-VolumesGetTestJSON-340541942 tempest-VolumesGetTestJSON-340541942-project] HTTP exception thrown: Volume 907088a8-ac12-40f7-ae08-ff8ad05bc6cf could not be found. Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e10dd123-2d10-4c8b-a4c4-88285f4e9fb6 tempest-VolumesGetTestJSON-340541942 tempest-VolumesGetTestJSON-340541942-project] Request method failure captured: Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/os-volumes/907088a8-ac12-40f7-ae08-ff8ad05bc6cf HTTP/1.1 Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvIobq2iagXXY8BgfZ6bKYY1Z1dZNZWLmMo7yW65kKwGWde1kHFw0hepcmdhYNM2AP5Cr77U6BUAZywDJ8q4N2sWgY0dkyb6y9F4EvqzxPp_usi8dD-36lG5yQOtJhlDkv8ZbGNKYVqpVR8u_btij_DPHecQO4BNWM02K0DpPotI9Q Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 353a55064b084db5985151b85435c5ec Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesGetTestJSON-340541942 Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:25:16.525574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:25:16.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/353a55064b084db5985151b85435c5ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_353a55064b084db5985151b85435c5ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/353a55064b084db5985151b85435c5ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/353a55064b084db5985151b85435c5ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:25:16.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesGetTestJSON-340541942 Aug 18 14:25:16.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 353a55064b084db5985151b85435c5ec Aug 18 14:25:16.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesGetTestJSON-340541942 Aug 18 14:25:16.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesGetTestJSON-340541942-project Aug 18 14:25:16.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:25:16.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:25:16.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 9bbd5074d7814bbbbb03a3483b373870 Aug 18 14:25:16.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesGetTestJSON-340541942-project Aug 18 14:25:16.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: Aug 18 14:25:16.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Volume 907088a8-ac12-40f7-ae08-ff8ad05bc6cf could not be found. Aug 18 14:25:16.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '907088a8-ac12-40f7-ae08-ff8ad05bc6cf'} Aug 18 14:25:16.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 907088a8-ac12-40f7-ae08-ff8ad05bc6cf could not be found. (HTTP 404) (Request-ID: req-51269085-23f8-4bfd-83e8-0bfee1d03adf) Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.528032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:25:16.529232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 907088a8-ac12-40f7-ae08-ff8ad05bc6cf could not be found. Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 14:25:16.530383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:25:16.531616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 907088a8-ac12-40f7-ae08-ff8ad05bc6cf could not be found. Aug 18 14:25:16.531616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.531616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.531616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.531616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.531616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:16.531616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:16.531616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:25:16.531616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:25:16.531616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 907088a8-ac12-40f7-ae08-ff8ad05bc6cf could not be found. Aug 18 14:25:16.531616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.531616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e10dd123-2d10-4c8b-a4c4-88285f4e9fb6 tempest-VolumesGetTestJSON-340541942 tempest-VolumesGetTestJSON-340541942-project] Returning 404 to user: Volume 907088a8-ac12-40f7-ae08-ff8ad05bc6cf could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:25:16.533289 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e10dd123-2d10-4c8b-a4c4-88285f4e9fb6 tempest-VolumesGetTestJSON-340541942 tempest-VolumesGetTestJSON-340541942-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/907088a8-ac12-40f7-ae08-ff8ad05bc6cf" status: 404 len: 109 microversion: 2.1 time: 0.200137 Aug 18 14:25:16.534338 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 27/47] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Aug 18 14:25:16 2022] GET /compute/v2.1/os-volumes/907088a8-ac12-40f7-ae08-ff8ad05bc6cf => generated 109 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:25:16.574461 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-11e38da7-52b9-421b-896a-80344aa226c8 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Action: 'create', calling method: .version_select at 0x7fb622455dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1969385567", "metadata": {"Type": "work"}}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-11e38da7-52b9-421b-896a-80344aa226c8 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Request method failure captured: Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 119 Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvL-klv2E4AE64SA13RAOH3sZPFVJYhwmDosw8aAkjyaqn5CmJzt1nKH1mx4GRaXirLmN4pVATASyrqqd2vLbmbS8Ojt00ojPN4UGAkUxsnyR44i0wYjHlggQl7jBVPFyGBgfhFkg4ffP9D6Whpx7FQEPTSLtdppLUZZk88qkPVd74 Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 9e9496e411b64f098958c9e3dc12dc9f Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:25:16.580313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:25:16.581607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:25:16.581607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.581607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 9e9496e411b64f098958c9e3dc12dc9f Aug 18 14:25:16.581607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.581607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesNegativeTest-1267506602-project Aug 18 14:25:16.581607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:25:16.581607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:25:16.581607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 016068e01096440690f7bb64b231ed3a Aug 18 14:25:16.581607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesNegativeTest-1267506602-project Aug 18 14:25:16.581607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Aug 18 14:25:16.581607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1969385567", "metadata": {"Type": "work"}}} Aug 18 14:25:16.581607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: Aug 18 14:25:16.581607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1969385567', 'metadata': {'Type': 'work'}}}} Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise error Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi '' Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:25:16.582395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 14:25:16.583698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 14:25:16.585112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 14:25:16.585112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.589686 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-11e38da7-52b9-421b-896a-80344aa226c8 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:25:16.591881 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-11e38da7-52b9-421b-896a-80344aa226c8 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.056361 Aug 18 14:25:16.599888 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 28/48] 10.222.0.39 () {60 vars in 1156 bytes} [Thu Aug 18 14:25:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:25:16.613734 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2fb49f5-e224-4ad1-b655-99fd77009210 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Calling method '.version_select at 0x7fb62246b940>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:16.679038 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-e2fb49f5-e224-4ad1-b655-99fd77009210 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] HTTP exception thrown: Volume tempest-invalid-1165700835 could not be found. Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2fb49f5-e224-4ad1-b655-99fd77009210 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Request method failure captured: Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1165700835 HTTP/1.1 Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvL-klv2E4AE64SA13RAOH3sZPFVJYhwmDosw8aAkjyaqn5CmJzt1nKH1mx4GRaXirLmN4pVATASyrqqd2vLbmbS8Ojt00ojPN4UGAkUxsnyR44i0wYjHlggQl7jBVPFyGBgfhFkg4ffP9D6Whpx7FQEPTSLtdppLUZZk88qkPVd74 Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 9e9496e411b64f098958c9e3dc12dc9f Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:25:16.681646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:25:16.683144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:25:16.683144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.683144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 9e9496e411b64f098958c9e3dc12dc9f Aug 18 14:25:16.683144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.683144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesNegativeTest-1267506602-project Aug 18 14:25:16.683144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:25:16.683144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:25:16.683144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 016068e01096440690f7bb64b231ed3a Aug 18 14:25:16.683144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesNegativeTest-1267506602-project Aug 18 14:25:16.683144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: Aug 18 14:25:16.683144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Volume tempest-invalid-1165700835 could not be found. Aug 18 14:25:16.683144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': 'tempest-invalid-1165700835'} Aug 18 14:25:16.683144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1165700835 could not be found. (HTTP 404) (Request-ID: req-df7c03a7-3949-4bfa-aacd-34a9f288e5d0) Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.683926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 14:25:16.685010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1165700835 could not be found. Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:25:16.686032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1165700835 could not be found. Aug 18 14:25:16.687331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.687331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.687331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.687331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.687331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:16.687331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:16.687331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:25:16.687331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:25:16.687331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1165700835 could not be found. Aug 18 14:25:16.687331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.687331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2fb49f5-e224-4ad1-b655-99fd77009210 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Returning 404 to user: Volume tempest-invalid-1165700835 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:25:16.689259 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e2fb49f5-e224-4ad1-b655-99fd77009210 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1165700835" status: 404 len: 99 microversion: 2.1 time: 0.079178 Aug 18 14:25:16.694184 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 29/49] 10.222.0.39 () {58 vars in 1218 bytes} [Thu Aug 18 14:25:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1165700835 => generated 99 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 14:25:16.701296 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-24f2ba43-da8c-404f-80a5-41970b2c64c9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:16.703528 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-24f2ba43-da8c-404f-80a5-41970b2c64c9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:16.712117 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-147a9889-0eb6-49ec-92e6-4796112c4f08 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:16.750054 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-147a9889-0eb6-49ec-92e6-4796112c4f08 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1241 microversion: 2.1 time: 0.431765 Aug 18 14:25:16.752305 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24f2ba43-da8c-404f-80a5-41970b2c64c9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:16.753097 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 21/50] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:16 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1241 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:16.754919 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24f2ba43-da8c-404f-80a5-41970b2c64c9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:16.756333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24f2ba43-da8c-404f-80a5-41970b2c64c9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:16.757797 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24f2ba43-da8c-404f-80a5-41970b2c64c9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:16.763718 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24f2ba43-da8c-404f-80a5-41970b2c64c9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:16.766701 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24f2ba43-da8c-404f-80a5-41970b2c64c9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:16.773696 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ea14e2ad-3be9-4de0-af92-20d0a14e6636 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.018659 Aug 18 14:25:16.775534 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 22/51] 10.222.0.39 () {58 vars in 1140 bytes} [Thu Aug 18 14:25:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 14:25:16.802576 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6e25e8fd-f3a7-472b-89f7-d1b4ae300068 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.020169 Aug 18 14:25:16.805287 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 23/52] 10.222.0.39 () {58 vars in 1137 bytes} [Thu Aug 18 14:25:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 14:25:16.828349 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bc147a8e-23af-4493-94e8-a34ae118e1ac tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Calling method '.version_select at 0x7fb623597160>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:16.936693 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-bc147a8e-23af-4493-94e8-a34ae118e1ac tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] HTTP exception thrown: Volume a6b6faf3-7882-4e44-8b9a-6db4cb5ff328 could not be found. Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bc147a8e-23af-4493-94e8-a34ae118e1ac tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Request method failure captured: Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/os-volumes/a6b6faf3-7882-4e44-8b9a-6db4cb5ff328 HTTP/1.1 Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvL-klv2E4AE64SA13RAOH3sZPFVJYhwmDosw8aAkjyaqn5CmJzt1nKH1mx4GRaXirLmN4pVATASyrqqd2vLbmbS8Ojt00ojPN4UGAkUxsnyR44i0wYjHlggQl7jBVPFyGBgfhFkg4ffP9D6Whpx7FQEPTSLtdppLUZZk88qkPVd74 Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 9e9496e411b64f098958c9e3dc12dc9f Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:25:16.939168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:25:16.940449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:25:16.940449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.940449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 9e9496e411b64f098958c9e3dc12dc9f Aug 18 14:25:16.940449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:16.940449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesNegativeTest-1267506602-project Aug 18 14:25:16.940449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:25:16.940449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:25:16.940449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 016068e01096440690f7bb64b231ed3a Aug 18 14:25:16.940449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesNegativeTest-1267506602-project Aug 18 14:25:16.940449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: Aug 18 14:25:16.940449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Volume a6b6faf3-7882-4e44-8b9a-6db4cb5ff328 could not be found. Aug 18 14:25:16.940449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': 'a6b6faf3-7882-4e44-8b9a-6db4cb5ff328'} Aug 18 14:25:16.940449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a6b6faf3-7882-4e44-8b9a-6db4cb5ff328 could not be found. (HTTP 404) (Request-ID: req-f80894f4-27b4-45c8-bc03-7a2ed559d169) Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.941226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 14:25:16.942323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a6b6faf3-7882-4e44-8b9a-6db4cb5ff328 could not be found. Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 14:25:16.944176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:25:16.946274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a6b6faf3-7882-4e44-8b9a-6db4cb5ff328 could not be found. Aug 18 14:25:16.946274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.946274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:16.946274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.946274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:16.946274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:16.946274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:16.946274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:25:16.946274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:25:16.946274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a6b6faf3-7882-4e44-8b9a-6db4cb5ff328 could not be found. Aug 18 14:25:16.946274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:16.946274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bc147a8e-23af-4493-94e8-a34ae118e1ac tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Returning 404 to user: Volume a6b6faf3-7882-4e44-8b9a-6db4cb5ff328 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:25:16.948802 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bc147a8e-23af-4493-94e8-a34ae118e1ac tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/a6b6faf3-7882-4e44-8b9a-6db4cb5ff328" status: 404 len: 109 microversion: 2.1 time: 0.134204 Aug 18 14:25:16.948802 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 24/53] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Aug 18 14:25:16 2022] DELETE /compute/v2.1/os-volumes/a6b6faf3-7882-4e44-8b9a-6db4cb5ff328 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:25:16.971990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b969c959-8bec-4d4d-bc31-739f6735d0b8 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Calling method '.version_select at 0x7fb622d67b80>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:17.075912 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-b969c959-8bec-4d4d-bc31-739f6735d0b8 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] HTTP exception thrown: Volume 93090a32-9f7e-416d-b3ca-3930a11533fd could not be found. Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b969c959-8bec-4d4d-bc31-739f6735d0b8 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Request method failure captured: Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/os-volumes/93090a32-9f7e-416d-b3ca-3930a11533fd HTTP/1.1 Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvL-klv2E4AE64SA13RAOH3sZPFVJYhwmDosw8aAkjyaqn5CmJzt1nKH1mx4GRaXirLmN4pVATASyrqqd2vLbmbS8Ojt00ojPN4UGAkUxsnyR44i0wYjHlggQl7jBVPFyGBgfhFkg4ffP9D6Whpx7FQEPTSLtdppLUZZk88qkPVd74 Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 9e9496e411b64f098958c9e3dc12dc9f Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:25:17.079205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:25:17.080732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e9496e411b64f098958c9e3dc12dc9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:25:17.080732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:17.080732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 9e9496e411b64f098958c9e3dc12dc9f Aug 18 14:25:17.080732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesNegativeTest-1267506602 Aug 18 14:25:17.080732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesNegativeTest-1267506602-project Aug 18 14:25:17.080732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:25:17.080732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:25:17.080732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 016068e01096440690f7bb64b231ed3a Aug 18 14:25:17.080732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesNegativeTest-1267506602-project Aug 18 14:25:17.080732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: Aug 18 14:25:17.080732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Volume 93090a32-9f7e-416d-b3ca-3930a11533fd could not be found. Aug 18 14:25:17.080732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '93090a32-9f7e-416d-b3ca-3930a11533fd'} Aug 18 14:25:17.080732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 93090a32-9f7e-416d-b3ca-3930a11533fd could not be found. (HTTP 404) (Request-ID: req-e96e5332-184c-44dd-b45f-2e7bb76b807a) Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:17.081589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 14:25:17.082711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 93090a32-9f7e-416d-b3ca-3930a11533fd could not be found. Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 14:25:17.084725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 93090a32-9f7e-416d-b3ca-3930a11533fd could not be found. Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 93090a32-9f7e-416d-b3ca-3930a11533fd could not be found. Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b969c959-8bec-4d4d-bc31-739f6735d0b8 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] Returning 404 to user: Volume 93090a32-9f7e-416d-b3ca-3930a11533fd could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b969c959-8bec-4d4d-bc31-739f6735d0b8 tempest-VolumesNegativeTest-1267506602 tempest-VolumesNegativeTest-1267506602-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/93090a32-9f7e-416d-b3ca-3930a11533fd" status: 404 len: 109 microversion: 2.1 time: 0.125995 Aug 18 14:25:17.098242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 25/54] 10.222.0.39 () {58 vars in 1245 bytes} [Thu Aug 18 14:25:16 2022] GET /compute/v2.1/os-volumes/93090a32-9f7e-416d-b3ca-3930a11533fd => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:25:17.307589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7af0fbcc-9ccd-49d7-8840-4b33eaab45bd tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:17.308230 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7af0fbcc-9ccd-49d7-8840-4b33eaab45bd tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:17.318978 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7af0fbcc-9ccd-49d7-8840-4b33eaab45bd tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:17.319238 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7af0fbcc-9ccd-49d7-8840-4b33eaab45bd tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:17.325588 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7af0fbcc-9ccd-49d7-8840-4b33eaab45bd tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:17.335908 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7af0fbcc-9ccd-49d7-8840-4b33eaab45bd tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:17.339095 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7af0fbcc-9ccd-49d7-8840-4b33eaab45bd tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:17.339634 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7af0fbcc-9ccd-49d7-8840-4b33eaab45bd tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:17.449511 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-24f2ba43-da8c-404f-80a5-41970b2c64c9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:17.470499 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-24f2ba43-da8c-404f-80a5-41970b2c64c9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1280 microversion: 2.1 time: 0.772662 Aug 18 14:25:17.472029 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 30/55] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:16 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1280 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:17.781775 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a74815e2-2e09-43e8-8864-8d23118e872f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:17.784337 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a74815e2-2e09-43e8-8864-8d23118e872f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:17.811887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a74815e2-2e09-43e8-8864-8d23118e872f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:17.811887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a74815e2-2e09-43e8-8864-8d23118e872f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:17.811887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a74815e2-2e09-43e8-8864-8d23118e872f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:17.811887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a74815e2-2e09-43e8-8864-8d23118e872f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:17.812464 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a74815e2-2e09-43e8-8864-8d23118e872f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:17.812949 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a74815e2-2e09-43e8-8864-8d23118e872f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:18.139207 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a74815e2-2e09-43e8-8864-8d23118e872f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:18.156289 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a74815e2-2e09-43e8-8864-8d23118e872f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1237 microversion: 2.1 time: 0.383613 Aug 18 14:25:18.171763 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7af0fbcc-9ccd-49d7-8840-4b33eaab45bd tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:18.186806 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 31/56] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:17 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1237 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:25:18.222845 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7af0fbcc-9ccd-49d7-8840-4b33eaab45bd tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1272 microversion: 2.1 time: 0.913525 Aug 18 14:25:18.225507 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 26/57] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:17 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1272 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:18.498458 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-db6e3791-d7a5-4e46-a8f6-af73ea6a9fec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:18.499908 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-db6e3791-d7a5-4e46-a8f6-af73ea6a9fec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:18.515811 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db6e3791-d7a5-4e46-a8f6-af73ea6a9fec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:18.517983 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db6e3791-d7a5-4e46-a8f6-af73ea6a9fec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:18.520283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db6e3791-d7a5-4e46-a8f6-af73ea6a9fec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:18.521233 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db6e3791-d7a5-4e46-a8f6-af73ea6a9fec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:18.522234 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db6e3791-d7a5-4e46-a8f6-af73ea6a9fec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:18.527002 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db6e3791-d7a5-4e46-a8f6-af73ea6a9fec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:18.757129 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-db6e3791-d7a5-4e46-a8f6-af73ea6a9fec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:18.777583 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-db6e3791-d7a5-4e46-a8f6-af73ea6a9fec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1278 microversion: 2.1 time: 0.284420 Aug 18 14:25:18.780952 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 32/58] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:18 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1278 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:19.214338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ad02f6b8-6cbb-4b2c-8f2a-df7ca42ebf16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:19.215206 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ad02f6b8-6cbb-4b2c-8f2a-df7ca42ebf16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:19.243556 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad02f6b8-6cbb-4b2c-8f2a-df7ca42ebf16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:19.246381 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad02f6b8-6cbb-4b2c-8f2a-df7ca42ebf16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:19.248070 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9f6bd893-d04d-4bf5-bfc5-71f47080f17e tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:19.248878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9f6bd893-d04d-4bf5-bfc5-71f47080f17e tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:19.249536 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad02f6b8-6cbb-4b2c-8f2a-df7ca42ebf16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:19.251250 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad02f6b8-6cbb-4b2c-8f2a-df7ca42ebf16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:19.255731 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad02f6b8-6cbb-4b2c-8f2a-df7ca42ebf16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:19.258944 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad02f6b8-6cbb-4b2c-8f2a-df7ca42ebf16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:19.266429 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f6bd893-d04d-4bf5-bfc5-71f47080f17e tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:19.269916 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f6bd893-d04d-4bf5-bfc5-71f47080f17e tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:19.279149 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f6bd893-d04d-4bf5-bfc5-71f47080f17e tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:19.280601 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f6bd893-d04d-4bf5-bfc5-71f47080f17e tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:19.289115 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f6bd893-d04d-4bf5-bfc5-71f47080f17e tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:19.289784 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f6bd893-d04d-4bf5-bfc5-71f47080f17e tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:19.610313 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ad02f6b8-6cbb-4b2c-8f2a-df7ca42ebf16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:19.622487 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ad02f6b8-6cbb-4b2c-8f2a-df7ca42ebf16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1299 microversion: 2.1 time: 0.415965 Aug 18 14:25:19.628045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 27/59] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:19 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1299 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:19.816222 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-04f7a731-70ba-477b-bbc1-e4825721dc0a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:19.817114 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-04f7a731-70ba-477b-bbc1-e4825721dc0a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:19.829865 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04f7a731-70ba-477b-bbc1-e4825721dc0a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:19.832318 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04f7a731-70ba-477b-bbc1-e4825721dc0a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:19.833039 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04f7a731-70ba-477b-bbc1-e4825721dc0a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:19.835863 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04f7a731-70ba-477b-bbc1-e4825721dc0a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:19.838361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04f7a731-70ba-477b-bbc1-e4825721dc0a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:19.840457 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04f7a731-70ba-477b-bbc1-e4825721dc0a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:19.930639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:25:20.200875 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-04f7a731-70ba-477b-bbc1-e4825721dc0a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:20.214761 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-04f7a731-70ba-477b-bbc1-e4825721dc0a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1278 microversion: 2.1 time: 0.411827 Aug 18 14:25:20.227559 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 28/60] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:19 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1278 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:20.230115 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9f6bd893-d04d-4bf5-bfc5-71f47080f17e tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:20.252046 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9f6bd893-d04d-4bf5-bfc5-71f47080f17e tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 1.009035 Aug 18 14:25:20.260543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 33/61] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:19 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:20.651307 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bb427bc6-cc04-4dfc-8ee6-28a6d3a849bf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:20.652130 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bb427bc6-cc04-4dfc-8ee6-28a6d3a849bf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:20.673365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb427bc6-cc04-4dfc-8ee6-28a6d3a849bf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:20.673991 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb427bc6-cc04-4dfc-8ee6-28a6d3a849bf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:20.674460 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb427bc6-cc04-4dfc-8ee6-28a6d3a849bf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:20.675178 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb427bc6-cc04-4dfc-8ee6-28a6d3a849bf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:20.675663 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb427bc6-cc04-4dfc-8ee6-28a6d3a849bf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:20.695641 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb427bc6-cc04-4dfc-8ee6-28a6d3a849bf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:21.245680 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-de91b0cb-9883-4aef-8ae4-8c0c4430817b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:21.247182 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-de91b0cb-9883-4aef-8ae4-8c0c4430817b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:21.258791 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de91b0cb-9883-4aef-8ae4-8c0c4430817b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:21.262709 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de91b0cb-9883-4aef-8ae4-8c0c4430817b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:21.263550 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de91b0cb-9883-4aef-8ae4-8c0c4430817b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:21.272605 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de91b0cb-9883-4aef-8ae4-8c0c4430817b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:21.273277 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de91b0cb-9883-4aef-8ae4-8c0c4430817b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:21.279586 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de91b0cb-9883-4aef-8ae4-8c0c4430817b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:21.456941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bb427bc6-cc04-4dfc-8ee6-28a6d3a849bf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:21.467775 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bb427bc6-cc04-4dfc-8ee6-28a6d3a849bf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1299 microversion: 2.1 time: 0.821253 Aug 18 14:25:21.499314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 29/62] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:20 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1299 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:21.513356 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d9b0557a-b53a-4fca-8274-04ae00e50e3a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:21.514331 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d9b0557a-b53a-4fca-8274-04ae00e50e3a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:21.525178 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9b0557a-b53a-4fca-8274-04ae00e50e3a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:21.527707 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9b0557a-b53a-4fca-8274-04ae00e50e3a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:21.535807 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9b0557a-b53a-4fca-8274-04ae00e50e3a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:21.536917 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9b0557a-b53a-4fca-8274-04ae00e50e3a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:21.537687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9b0557a-b53a-4fca-8274-04ae00e50e3a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:21.538336 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9b0557a-b53a-4fca-8274-04ae00e50e3a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:21.670016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-de91b0cb-9883-4aef-8ae4-8c0c4430817b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:21.685016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-de91b0cb-9883-4aef-8ae4-8c0c4430817b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1278 microversion: 2.1 time: 0.443584 Aug 18 14:25:21.686200 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 34/63] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:21 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1278 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:22.513080 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a97f9e23-1e87-4780-9e21-f833432f8dec tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:22.515272 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a97f9e23-1e87-4780-9e21-f833432f8dec tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:22.534178 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a97f9e23-1e87-4780-9e21-f833432f8dec tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:22.534993 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a97f9e23-1e87-4780-9e21-f833432f8dec tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:22.536098 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a97f9e23-1e87-4780-9e21-f833432f8dec tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:22.550329 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a97f9e23-1e87-4780-9e21-f833432f8dec tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:22.550783 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a97f9e23-1e87-4780-9e21-f833432f8dec tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:22.551240 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a97f9e23-1e87-4780-9e21-f833432f8dec tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:22.674458 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d9b0557a-b53a-4fca-8274-04ae00e50e3a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:22.683257 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d9b0557a-b53a-4fca-8274-04ae00e50e3a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 1.182404 Aug 18 14:25:22.699763 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 30/64] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:21 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:22.706078 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7827dc8c-1fed-4683-a60a-2191a630e648 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:22.707187 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7827dc8c-1fed-4683-a60a-2191a630e648 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:22.719453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7827dc8c-1fed-4683-a60a-2191a630e648 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:22.720482 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7827dc8c-1fed-4683-a60a-2191a630e648 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:22.721070 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7827dc8c-1fed-4683-a60a-2191a630e648 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:22.721941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7827dc8c-1fed-4683-a60a-2191a630e648 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:22.722562 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7827dc8c-1fed-4683-a60a-2191a630e648 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:22.736107 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7827dc8c-1fed-4683-a60a-2191a630e648 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:22.794300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a97f9e23-1e87-4780-9e21-f833432f8dec tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:22.803563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a97f9e23-1e87-4780-9e21-f833432f8dec tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1299 microversion: 2.1 time: 0.300006 Aug 18 14:25:22.804658 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 35/65] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:22 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1299 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:23.156470 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7827dc8c-1fed-4683-a60a-2191a630e648 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:23.168532 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7827dc8c-1fed-4683-a60a-2191a630e648 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.463967 Aug 18 14:25:23.184111 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 31/66] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:22 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:25:23.709175 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-44717e30-eca7-4f87-a784-0d30062bf358 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:23.709961 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-44717e30-eca7-4f87-a784-0d30062bf358 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:23.711987 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=16 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:25:23.730540 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44717e30-eca7-4f87-a784-0d30062bf358 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:23.732430 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44717e30-eca7-4f87-a784-0d30062bf358 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:23.734534 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44717e30-eca7-4f87-a784-0d30062bf358 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:23.737385 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44717e30-eca7-4f87-a784-0d30062bf358 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:23.739630 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44717e30-eca7-4f87-a784-0d30062bf358 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:23.741852 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44717e30-eca7-4f87-a784-0d30062bf358 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:23.827314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c5227c2f-cd0d-4f96-a481-2772ece54288 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:23.829104 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c5227c2f-cd0d-4f96-a481-2772ece54288 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:23.846563 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5227c2f-cd0d-4f96-a481-2772ece54288 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:23.851333 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5227c2f-cd0d-4f96-a481-2772ece54288 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:23.852988 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5227c2f-cd0d-4f96-a481-2772ece54288 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:23.855187 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5227c2f-cd0d-4f96-a481-2772ece54288 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:23.875361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5227c2f-cd0d-4f96-a481-2772ece54288 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:23.881679 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5227c2f-cd0d-4f96-a481-2772ece54288 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:24.376906 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-44717e30-eca7-4f87-a784-0d30062bf358 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:24.408752 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-44717e30-eca7-4f87-a784-0d30062bf358 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.700450 Aug 18 14:25:24.410780 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 36/67] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:23 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:24.417045 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b7298ffb-045b-4355-941c-d65e4fe938f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:24.417900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b7298ffb-045b-4355-941c-d65e4fe938f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:24.436105 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7298ffb-045b-4355-941c-d65e4fe938f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:24.439953 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7298ffb-045b-4355-941c-d65e4fe938f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:24.441046 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7298ffb-045b-4355-941c-d65e4fe938f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:24.445215 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7298ffb-045b-4355-941c-d65e4fe938f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:24.446006 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7298ffb-045b-4355-941c-d65e4fe938f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:24.447998 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7298ffb-045b-4355-941c-d65e4fe938f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:24.949945 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c5227c2f-cd0d-4f96-a481-2772ece54288 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:24.962962 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c5227c2f-cd0d-4f96-a481-2772ece54288 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 1.139856 Aug 18 14:25:24.979937 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 32/68] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:23 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:25.436328 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d9b4b05e-cafb-4277-be11-f03de092078f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:25.437108 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d9b4b05e-cafb-4277-be11-f03de092078f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:25.449170 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b7298ffb-045b-4355-941c-d65e4fe938f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:25.452335 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9b4b05e-cafb-4277-be11-f03de092078f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:25.452900 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9b4b05e-cafb-4277-be11-f03de092078f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:25.455961 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9b4b05e-cafb-4277-be11-f03de092078f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:25.459719 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9b4b05e-cafb-4277-be11-f03de092078f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:25.461737 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9b4b05e-cafb-4277-be11-f03de092078f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:25.462413 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9b4b05e-cafb-4277-be11-f03de092078f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:25.467540 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b7298ffb-045b-4355-941c-d65e4fe938f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 1.055427 Aug 18 14:25:25.478273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 37/69] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:24 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:25.987227 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-05bef247-001c-4570-9694-dae974a4ea4d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:25.988187 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-05bef247-001c-4570-9694-dae974a4ea4d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:26.001173 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:25:26.003535 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-05bef247-001c-4570-9694-dae974a4ea4d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:26.006663 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-05bef247-001c-4570-9694-dae974a4ea4d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:26.007283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-05bef247-001c-4570-9694-dae974a4ea4d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:26.008198 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-05bef247-001c-4570-9694-dae974a4ea4d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:26.013902 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-05bef247-001c-4570-9694-dae974a4ea4d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:26.014630 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-05bef247-001c-4570-9694-dae974a4ea4d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:26.709575 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-05bef247-001c-4570-9694-dae974a4ea4d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:26.719520 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-05bef247-001c-4570-9694-dae974a4ea4d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.736380 Aug 18 14:25:26.720827 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=24 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:25:26.749444 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 38/70] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:25 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:25:27.509848 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d9b4b05e-cafb-4277-be11-f03de092078f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:27.531157 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d9b4b05e-cafb-4277-be11-f03de092078f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 2.094911 Aug 18 14:25:27.532225 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 33/71] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:25 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:27.574871 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f85537eb-bdfe-4aa6-8182-368284bbd660 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:27.578322 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f85537eb-bdfe-4aa6-8182-368284bbd660 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:27.607695 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f85537eb-bdfe-4aa6-8182-368284bbd660 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:27.609205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f85537eb-bdfe-4aa6-8182-368284bbd660 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:27.611325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f85537eb-bdfe-4aa6-8182-368284bbd660 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:27.614110 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f85537eb-bdfe-4aa6-8182-368284bbd660 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:27.615350 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f85537eb-bdfe-4aa6-8182-368284bbd660 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:27.616648 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f85537eb-bdfe-4aa6-8182-368284bbd660 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:27.667545 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-2bab02ee-b567-424b-bfb5-ba097299aefe req-ea9163ab-40e1-450e-b44a-78ffba3f5621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f20af96f-d292-44e9-aa06-ab61a806780a", "tag": "050a7162-7214-4069-b7ab-6d6edbf76cbf"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:27.718143 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2bab02ee-b567-424b-bfb5-ba097299aefe req-ea9163ab-40e1-450e-b44a-78ffba3f5621 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:27.721618 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2bab02ee-b567-424b-bfb5-ba097299aefe req-ea9163ab-40e1-450e-b44a-78ffba3f5621 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:27.723224 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2bab02ee-b567-424b-bfb5-ba097299aefe req-ea9163ab-40e1-450e-b44a-78ffba3f5621 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:27.794017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-2bab02ee-b567-424b-bfb5-ba097299aefe req-ea9163ab-40e1-450e-b44a-78ffba3f5621 service nova] Creating event network-changed:050a7162-7214-4069-b7ab-6d6edbf76cbf for instance f20af96f-d292-44e9-aa06-ab61a806780a on hv-cinder-85220 Aug 18 14:25:27.797913 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2bab02ee-b567-424b-bfb5-ba097299aefe req-ea9163ab-40e1-450e-b44a-78ffba3f5621 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120538) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 14:25:27.798933 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2bab02ee-b567-424b-bfb5-ba097299aefe req-ea9163ab-40e1-450e-b44a-78ffba3f5621 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120538) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 14:25:27.803541 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a9dd3e3-a18a-4bca-82bb-a35b2a95c1c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:27.804307 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a9dd3e3-a18a-4bca-82bb-a35b2a95c1c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:27.804947 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a9dd3e3-a18a-4bca-82bb-a35b2a95c1c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:27.806953 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a9dd3e3-a18a-4bca-82bb-a35b2a95c1c2 None None] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:27.809148 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a9dd3e3-a18a-4bca-82bb-a35b2a95c1c2 None None] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:27.824441 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a9dd3e3-a18a-4bca-82bb-a35b2a95c1c2 None None] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:27.852304 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.compute.rpcapi [None req-8a9dd3e3-a18a-4bca-82bb-a35b2a95c1c2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 14:25:27.853931 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a9dd3e3-a18a-4bca-82bb-a35b2a95c1c2 None None] Releasing lock "compute-rpcapi-router" {{(pid=120538) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 14:25:27.900632 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8a9dd3e3-a18a-4bca-82bb-a35b2a95c1c2 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.147667 Aug 18 14:25:27.902121 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 39/72] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:27.911122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f28ab192-0a5f-44eb-8fc8-4e0b2961328d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:27.912393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f28ab192-0a5f-44eb-8fc8-4e0b2961328d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:27.932219 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f28ab192-0a5f-44eb-8fc8-4e0b2961328d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:27.935306 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f28ab192-0a5f-44eb-8fc8-4e0b2961328d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:27.937509 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f28ab192-0a5f-44eb-8fc8-4e0b2961328d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:27.940328 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f28ab192-0a5f-44eb-8fc8-4e0b2961328d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:27.944555 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f28ab192-0a5f-44eb-8fc8-4e0b2961328d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:27.946087 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f28ab192-0a5f-44eb-8fc8-4e0b2961328d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:28.227212 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f85537eb-bdfe-4aa6-8182-368284bbd660 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:28.244731 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f85537eb-bdfe-4aa6-8182-368284bbd660 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.692540 Aug 18 14:25:28.245322 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 34/73] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:27 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:28.606114 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f28ab192-0a5f-44eb-8fc8-4e0b2961328d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:28.624666 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f28ab192-0a5f-44eb-8fc8-4e0b2961328d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.714507 Aug 18 14:25:28.630119 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 40/74] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:27 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:28.658557 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-945514b9-43e7-4abb-b45b-1111d1c30722 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:28.667548 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-945514b9-43e7-4abb-b45b-1111d1c30722 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:28.699505 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-945514b9-43e7-4abb-b45b-1111d1c30722 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:28.706409 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-945514b9-43e7-4abb-b45b-1111d1c30722 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:28.710164 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-945514b9-43e7-4abb-b45b-1111d1c30722 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:28.716898 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-945514b9-43e7-4abb-b45b-1111d1c30722 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:28.718847 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-945514b9-43e7-4abb-b45b-1111d1c30722 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:28.719439 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-945514b9-43e7-4abb-b45b-1111d1c30722 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:29.193277 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-384a0160-2e16-45ed-aeca-8c4da655136f req-961f9a4a-5f1a-4c14-b0e2-47b54802dc0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "222bc1f0-96b3-4d29-960a-39437b4dc0a5", "tag": "23ad159c-abaf-411f-bb62-90941b33a93c"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:29.233908 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-384a0160-2e16-45ed-aeca-8c4da655136f req-961f9a4a-5f1a-4c14-b0e2-47b54802dc0d service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:29.238427 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-384a0160-2e16-45ed-aeca-8c4da655136f req-961f9a4a-5f1a-4c14-b0e2-47b54802dc0d service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:29.239461 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-384a0160-2e16-45ed-aeca-8c4da655136f req-961f9a4a-5f1a-4c14-b0e2-47b54802dc0d service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:29.322323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-384a0160-2e16-45ed-aeca-8c4da655136f req-961f9a4a-5f1a-4c14-b0e2-47b54802dc0d service nova] Creating event network-changed:23ad159c-abaf-411f-bb62-90941b33a93c for instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 on hv-cinder-85220 Aug 18 14:25:29.322997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-384a0160-2e16-45ed-aeca-8c4da655136f req-961f9a4a-5f1a-4c14-b0e2-47b54802dc0d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 14:25:29.323656 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-384a0160-2e16-45ed-aeca-8c4da655136f req-961f9a4a-5f1a-4c14-b0e2-47b54802dc0d service nova] Acquired lock "compute-rpcapi-router" {{(pid=120539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 14:25:29.324845 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ef6d035-7a0b-4666-bba1-d8296e7275c1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:29.329222 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ef6d035-7a0b-4666-bba1-d8296e7275c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:29.330546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ef6d035-7a0b-4666-bba1-d8296e7275c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:29.332532 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ef6d035-7a0b-4666-bba1-d8296e7275c1 None None] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:29.334971 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ef6d035-7a0b-4666-bba1-d8296e7275c1 None None] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:29.336879 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ef6d035-7a0b-4666-bba1-d8296e7275c1 None None] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:29.364837 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.compute.rpcapi [None req-1ef6d035-7a0b-4666-bba1-d8296e7275c1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 14:25:29.370499 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ef6d035-7a0b-4666-bba1-d8296e7275c1 None None] Releasing lock "compute-rpcapi-router" {{(pid=120539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 14:25:29.405023 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1ef6d035-7a0b-4666-bba1-d8296e7275c1 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.887826 Aug 18 14:25:29.406371 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 35/75] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:25:29.412085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9060eb42-d32b-4e5e-b767-c06bf4a3083a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:29.414006 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9060eb42-d32b-4e5e-b767-c06bf4a3083a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:29.429328 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9060eb42-d32b-4e5e-b767-c06bf4a3083a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:29.434241 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9060eb42-d32b-4e5e-b767-c06bf4a3083a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:29.434978 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9060eb42-d32b-4e5e-b767-c06bf4a3083a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:29.436053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9060eb42-d32b-4e5e-b767-c06bf4a3083a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:29.436956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9060eb42-d32b-4e5e-b767-c06bf4a3083a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:29.437627 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9060eb42-d32b-4e5e-b767-c06bf4a3083a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:29.987562 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9060eb42-d32b-4e5e-b767-c06bf4a3083a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:30.005212 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9060eb42-d32b-4e5e-b767-c06bf4a3083a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.597364 Aug 18 14:25:30.005997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 36/76] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:29 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:30.023561 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e88d24d3-0fbd-4edf-9094-8028b5543b22 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:30.025376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e88d24d3-0fbd-4edf-9094-8028b5543b22 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:30.053215 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e88d24d3-0fbd-4edf-9094-8028b5543b22 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:30.054867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e88d24d3-0fbd-4edf-9094-8028b5543b22 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:30.057473 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e88d24d3-0fbd-4edf-9094-8028b5543b22 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:30.060220 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e88d24d3-0fbd-4edf-9094-8028b5543b22 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:30.063311 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e88d24d3-0fbd-4edf-9094-8028b5543b22 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:30.066205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e88d24d3-0fbd-4edf-9094-8028b5543b22 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:30.233633 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-945514b9-43e7-4abb-b45b-1111d1c30722 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:30.253536 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-945514b9-43e7-4abb-b45b-1111d1c30722 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 1.618134 Aug 18 14:25:30.257258 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 41/77] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:28 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:30.272927 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-b33ba1e2-3922-4d45-8473-91c942f92363 req-ca117ef1-d557-40b8-bed8-6ea4641620c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed05a0ad-3aad-4113-b8b3-8daa97e04f2f", "tag": "4de21cfe-6345-4dbd-890d-aa61bf0849bf"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:30.299481 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b33ba1e2-3922-4d45-8473-91c942f92363 req-ca117ef1-d557-40b8-bed8-6ea4641620c9 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:30.301048 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b33ba1e2-3922-4d45-8473-91c942f92363 req-ca117ef1-d557-40b8-bed8-6ea4641620c9 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:30.306174 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b33ba1e2-3922-4d45-8473-91c942f92363 req-ca117ef1-d557-40b8-bed8-6ea4641620c9 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:30.345857 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-b33ba1e2-3922-4d45-8473-91c942f92363 req-ca117ef1-d557-40b8-bed8-6ea4641620c9 service nova] Creating event network-changed:4de21cfe-6345-4dbd-890d-aa61bf0849bf for instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f on hv-cinder-85220 Aug 18 14:25:30.350277 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e88d24d3-0fbd-4edf-9094-8028b5543b22 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:30.359079 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e88d24d3-0fbd-4edf-9094-8028b5543b22 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.351823 Aug 18 14:25:30.360159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 37/78] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:30 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:30.361447 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-b33ba1e2-3922-4d45-8473-91c942f92363 req-ca117ef1-d557-40b8-bed8-6ea4641620c9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102318 Aug 18 14:25:30.361804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 42/79] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:31.028928 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c59f178b-4e5a-483a-8804-095af5163753 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:31.030299 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c59f178b-4e5a-483a-8804-095af5163753 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:31.045322 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c59f178b-4e5a-483a-8804-095af5163753 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:31.046293 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c59f178b-4e5a-483a-8804-095af5163753 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:31.047513 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c59f178b-4e5a-483a-8804-095af5163753 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:31.049345 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c59f178b-4e5a-483a-8804-095af5163753 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:31.051881 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c59f178b-4e5a-483a-8804-095af5163753 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:31.053309 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c59f178b-4e5a-483a-8804-095af5163753 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:31.282293 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ea19e272-5212-4425-8eae-960d0ae57004 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:31.283403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ea19e272-5212-4425-8eae-960d0ae57004 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:31.290966 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea19e272-5212-4425-8eae-960d0ae57004 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:31.291753 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea19e272-5212-4425-8eae-960d0ae57004 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:31.292194 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea19e272-5212-4425-8eae-960d0ae57004 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:31.292892 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea19e272-5212-4425-8eae-960d0ae57004 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:31.293467 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea19e272-5212-4425-8eae-960d0ae57004 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:31.293875 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea19e272-5212-4425-8eae-960d0ae57004 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:31.367559 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c59f178b-4e5a-483a-8804-095af5163753 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:31.382961 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c59f178b-4e5a-483a-8804-095af5163753 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.356729 Aug 18 14:25:31.386539 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 38/80] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:31 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:31.408186 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e40cfdd6-af01-4c31-8e2a-950b64c1f153 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:31.410088 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e40cfdd6-af01-4c31-8e2a-950b64c1f153 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:31.429397 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e40cfdd6-af01-4c31-8e2a-950b64c1f153 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:31.429815 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e40cfdd6-af01-4c31-8e2a-950b64c1f153 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:31.432769 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e40cfdd6-af01-4c31-8e2a-950b64c1f153 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:31.433508 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e40cfdd6-af01-4c31-8e2a-950b64c1f153 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:31.433969 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e40cfdd6-af01-4c31-8e2a-950b64c1f153 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:31.435770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e40cfdd6-af01-4c31-8e2a-950b64c1f153 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:31.469400 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ea19e272-5212-4425-8eae-960d0ae57004 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:31.480975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ea19e272-5212-4425-8eae-960d0ae57004 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.205585 Aug 18 14:25:31.482360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 43/81] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:31 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:31.642434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-0bf69d78-2bc2-47e0-bf84-27783c4711c8 req-81b7698f-1d02-41a3-9f32-b2c2f378d6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5932e419-fd0d-407e-86bf-4855a74ea353", "tag": "7764691c-d09f-48e5-b6d6-986f0882a254"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:31.657547 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e40cfdd6-af01-4c31-8e2a-950b64c1f153 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:31.668088 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-0bf69d78-2bc2-47e0-bf84-27783c4711c8 req-81b7698f-1d02-41a3-9f32-b2c2f378d6c0 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:31.668865 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-0bf69d78-2bc2-47e0-bf84-27783c4711c8 req-81b7698f-1d02-41a3-9f32-b2c2f378d6c0 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:31.669126 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e40cfdd6-af01-4c31-8e2a-950b64c1f153 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.274132 Aug 18 14:25:31.669754 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-0bf69d78-2bc2-47e0-bf84-27783c4711c8 req-81b7698f-1d02-41a3-9f32-b2c2f378d6c0 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:31.670928 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 39/82] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:31 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:31.709769 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-0bf69d78-2bc2-47e0-bf84-27783c4711c8 req-81b7698f-1d02-41a3-9f32-b2c2f378d6c0 service nova] Creating event network-changed:7764691c-d09f-48e5-b6d6-986f0882a254 for instance 5932e419-fd0d-407e-86bf-4855a74ea353 on hv-cinder-85220 Aug 18 14:25:31.717429 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-0bf69d78-2bc2-47e0-bf84-27783c4711c8 req-81b7698f-1d02-41a3-9f32-b2c2f378d6c0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083703 Aug 18 14:25:31.718025 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 44/83] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:32.409681 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-38014f81-dc6c-4858-a351-a457c3e86cc5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:32.410850 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-38014f81-dc6c-4858-a351-a457c3e86cc5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:32.420049 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38014f81-dc6c-4858-a351-a457c3e86cc5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:32.420763 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38014f81-dc6c-4858-a351-a457c3e86cc5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:32.421403 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38014f81-dc6c-4858-a351-a457c3e86cc5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:32.422497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38014f81-dc6c-4858-a351-a457c3e86cc5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:32.423690 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38014f81-dc6c-4858-a351-a457c3e86cc5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:32.424359 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38014f81-dc6c-4858-a351-a457c3e86cc5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:32.505060 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b7da80a9-ac9b-4144-8347-9a37657f7202 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:32.505766 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b7da80a9-ac9b-4144-8347-9a37657f7202 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:32.507785 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:25:32.514887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7da80a9-ac9b-4144-8347-9a37657f7202 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:32.515401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7da80a9-ac9b-4144-8347-9a37657f7202 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:32.515846 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7da80a9-ac9b-4144-8347-9a37657f7202 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:32.516541 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7da80a9-ac9b-4144-8347-9a37657f7202 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:32.517459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7da80a9-ac9b-4144-8347-9a37657f7202 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:32.517889 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7da80a9-ac9b-4144-8347-9a37657f7202 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:32.523276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=95 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:25:32.724190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b7da80a9-ac9b-4144-8347-9a37657f7202 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:32.733109 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b7da80a9-ac9b-4144-8347-9a37657f7202 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.232155 Aug 18 14:25:32.734053 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 45/84] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:32 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:32.739063 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0ef6cf61-ee3a-41bc-bcee-c1dfa6e7aded tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:32.739704 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0ef6cf61-ee3a-41bc-bcee-c1dfa6e7aded tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:32.759459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ef6cf61-ee3a-41bc-bcee-c1dfa6e7aded tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:32.759968 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ef6cf61-ee3a-41bc-bcee-c1dfa6e7aded tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:32.760687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ef6cf61-ee3a-41bc-bcee-c1dfa6e7aded tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:32.761901 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ef6cf61-ee3a-41bc-bcee-c1dfa6e7aded tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:32.762500 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ef6cf61-ee3a-41bc-bcee-c1dfa6e7aded tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:32.763073 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ef6cf61-ee3a-41bc-bcee-c1dfa6e7aded tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:32.893609 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-38014f81-dc6c-4858-a351-a457c3e86cc5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:32.916539 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-38014f81-dc6c-4858-a351-a457c3e86cc5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.510547 Aug 18 14:25:32.918023 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 40/85] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:32 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:33.209306 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0ef6cf61-ee3a-41bc-bcee-c1dfa6e7aded tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:33.220831 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0ef6cf61-ee3a-41bc-bcee-c1dfa6e7aded tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.485384 Aug 18 14:25:33.223663 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 46/86] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:32 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:33.758781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d94f119-e294-49f4-80b9-4eca5bb03160 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:33.762352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7d94f119-e294-49f4-80b9-4eca5bb03160 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:33.793770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d94f119-e294-49f4-80b9-4eca5bb03160 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:33.795520 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d94f119-e294-49f4-80b9-4eca5bb03160 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:33.799346 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d94f119-e294-49f4-80b9-4eca5bb03160 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:33.805946 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d94f119-e294-49f4-80b9-4eca5bb03160 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:33.809690 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d94f119-e294-49f4-80b9-4eca5bb03160 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:33.812016 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d94f119-e294-49f4-80b9-4eca5bb03160 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:33.954591 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-44ce85ec-a0ba-4eeb-9d4d-a7239530954b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:33.956208 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-44ce85ec-a0ba-4eeb-9d4d-a7239530954b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:33.969522 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44ce85ec-a0ba-4eeb-9d4d-a7239530954b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:33.970914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44ce85ec-a0ba-4eeb-9d4d-a7239530954b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:33.972372 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44ce85ec-a0ba-4eeb-9d4d-a7239530954b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:33.974071 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44ce85ec-a0ba-4eeb-9d4d-a7239530954b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:33.974646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44ce85ec-a0ba-4eeb-9d4d-a7239530954b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:33.975118 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44ce85ec-a0ba-4eeb-9d4d-a7239530954b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:34.512222 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7d94f119-e294-49f4-80b9-4eca5bb03160 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:34.515731 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:25:34.520262 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d94f119-e294-49f4-80b9-4eca5bb03160 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.765609 Aug 18 14:25:34.520901 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 41/87] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:33 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:34.536057 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-63f75777-463a-4164-a5d8-a2c174357f2b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:34.537919 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-63f75777-463a-4164-a5d8-a2c174357f2b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:34.554973 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63f75777-463a-4164-a5d8-a2c174357f2b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:34.555781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63f75777-463a-4164-a5d8-a2c174357f2b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:34.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63f75777-463a-4164-a5d8-a2c174357f2b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:34.557647 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63f75777-463a-4164-a5d8-a2c174357f2b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:34.558240 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63f75777-463a-4164-a5d8-a2c174357f2b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:34.558794 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63f75777-463a-4164-a5d8-a2c174357f2b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:34.609584 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-44ce85ec-a0ba-4eeb-9d4d-a7239530954b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:34.619939 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-44ce85ec-a0ba-4eeb-9d4d-a7239530954b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.668997 Aug 18 14:25:34.620526 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 47/88] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:33 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:34.812916 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-63f75777-463a-4164-a5d8-a2c174357f2b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:34.828255 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-63f75777-463a-4164-a5d8-a2c174357f2b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.306153 Aug 18 14:25:34.837663 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 42/89] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:34 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:35.545949 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d4740672-b773-405b-b0ce-b781ed57fbd8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:35.546597 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d4740672-b773-405b-b0ce-b781ed57fbd8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:35.553425 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4740672-b773-405b-b0ce-b781ed57fbd8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:35.554244 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4740672-b773-405b-b0ce-b781ed57fbd8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:35.554749 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4740672-b773-405b-b0ce-b781ed57fbd8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:35.556442 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4740672-b773-405b-b0ce-b781ed57fbd8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:35.557092 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4740672-b773-405b-b0ce-b781ed57fbd8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:35.557724 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4740672-b773-405b-b0ce-b781ed57fbd8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:35.643469 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ef843c36-4729-4f53-afea-1cd80e29e4d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:35.644702 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ef843c36-4729-4f53-afea-1cd80e29e4d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:35.661043 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef843c36-4729-4f53-afea-1cd80e29e4d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:35.661886 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef843c36-4729-4f53-afea-1cd80e29e4d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:35.662527 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef843c36-4729-4f53-afea-1cd80e29e4d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:35.667404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef843c36-4729-4f53-afea-1cd80e29e4d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:35.668952 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef843c36-4729-4f53-afea-1cd80e29e4d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:35.670279 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef843c36-4729-4f53-afea-1cd80e29e4d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:35.894137 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d4740672-b773-405b-b0ce-b781ed57fbd8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:35.904129 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d4740672-b773-405b-b0ce-b781ed57fbd8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.361137 Aug 18 14:25:35.918620 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 48/90] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:35 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:35.924333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-852989f2-19ef-4fb9-a865-c1a255ec6595 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:35.925169 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-852989f2-19ef-4fb9-a865-c1a255ec6595 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:35.933999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-852989f2-19ef-4fb9-a865-c1a255ec6595 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:35.934797 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-852989f2-19ef-4fb9-a865-c1a255ec6595 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:35.935549 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-852989f2-19ef-4fb9-a865-c1a255ec6595 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:35.936414 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-852989f2-19ef-4fb9-a865-c1a255ec6595 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:35.937145 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-852989f2-19ef-4fb9-a865-c1a255ec6595 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:35.937715 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-852989f2-19ef-4fb9-a865-c1a255ec6595 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:36.014784 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ef843c36-4729-4f53-afea-1cd80e29e4d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:36.037994 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ef843c36-4729-4f53-afea-1cd80e29e4d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.400879 Aug 18 14:25:36.040769 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 43/91] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:35 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:36.191122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-852989f2-19ef-4fb9-a865-c1a255ec6595 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:36.204115 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-852989f2-19ef-4fb9-a865-c1a255ec6595 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.284039 Aug 18 14:25:36.207721 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 49/92] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:35 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:36.926103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2eb83b2b-98af-4c85-b4cb-b832051eeb53 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:36.926742 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2eb83b2b-98af-4c85-b4cb-b832051eeb53 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:36.931392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:25:36.935549 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2eb83b2b-98af-4c85-b4cb-b832051eeb53 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:36.935990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2eb83b2b-98af-4c85-b4cb-b832051eeb53 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:36.936384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2eb83b2b-98af-4c85-b4cb-b832051eeb53 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:36.938926 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2eb83b2b-98af-4c85-b4cb-b832051eeb53 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:36.939817 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2eb83b2b-98af-4c85-b4cb-b832051eeb53 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:36.940852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2eb83b2b-98af-4c85-b4cb-b832051eeb53 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:37.060988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-41a14671-6747-49ef-9119-c8fa5947071b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:37.061604 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-41a14671-6747-49ef-9119-c8fa5947071b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:37.073873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41a14671-6747-49ef-9119-c8fa5947071b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:37.074488 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41a14671-6747-49ef-9119-c8fa5947071b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:37.075005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41a14671-6747-49ef-9119-c8fa5947071b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:37.075834 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41a14671-6747-49ef-9119-c8fa5947071b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:37.076360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41a14671-6747-49ef-9119-c8fa5947071b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:37.076888 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41a14671-6747-49ef-9119-c8fa5947071b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:37.241368 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2eb83b2b-98af-4c85-b4cb-b832051eeb53 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:37.256173 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2eb83b2b-98af-4c85-b4cb-b832051eeb53 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.334057 Aug 18 14:25:37.257678 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 44/93] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:36 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:37.266879 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6ab81daf-3c79-4084-96cb-88be649c6002 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:37.268866 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6ab81daf-3c79-4084-96cb-88be649c6002 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:37.278944 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ab81daf-3c79-4084-96cb-88be649c6002 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:37.279857 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ab81daf-3c79-4084-96cb-88be649c6002 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:37.281051 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ab81daf-3c79-4084-96cb-88be649c6002 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:37.282256 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ab81daf-3c79-4084-96cb-88be649c6002 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:37.282899 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ab81daf-3c79-4084-96cb-88be649c6002 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:37.284363 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ab81daf-3c79-4084-96cb-88be649c6002 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:37.424447 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-41a14671-6747-49ef-9119-c8fa5947071b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:37.435204 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-41a14671-6747-49ef-9119-c8fa5947071b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.377930 Aug 18 14:25:37.437067 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 50/94] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:37 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:37.514984 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6ab81daf-3c79-4084-96cb-88be649c6002 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:37.523946 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6ab81daf-3c79-4084-96cb-88be649c6002 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.263943 Aug 18 14:25:37.525249 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 45/95] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:37 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:38.283491 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6598bd2a-d33d-42a5-a262-b65472ea65e6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:38.286065 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6598bd2a-d33d-42a5-a262-b65472ea65e6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:38.295938 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:25:38.298886 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6598bd2a-d33d-42a5-a262-b65472ea65e6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:38.299665 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6598bd2a-d33d-42a5-a262-b65472ea65e6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:38.300164 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6598bd2a-d33d-42a5-a262-b65472ea65e6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:38.301058 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6598bd2a-d33d-42a5-a262-b65472ea65e6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:38.301698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6598bd2a-d33d-42a5-a262-b65472ea65e6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:38.302300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6598bd2a-d33d-42a5-a262-b65472ea65e6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:38.460245 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f829fd2f-f87b-4311-a86c-fbbc2ed55b70 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:38.461367 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f829fd2f-f87b-4311-a86c-fbbc2ed55b70 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:38.469730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f829fd2f-f87b-4311-a86c-fbbc2ed55b70 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:38.470641 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f829fd2f-f87b-4311-a86c-fbbc2ed55b70 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:38.471066 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f829fd2f-f87b-4311-a86c-fbbc2ed55b70 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:38.472150 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f829fd2f-f87b-4311-a86c-fbbc2ed55b70 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:38.472785 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f829fd2f-f87b-4311-a86c-fbbc2ed55b70 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:38.473348 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f829fd2f-f87b-4311-a86c-fbbc2ed55b70 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:38.518345 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6598bd2a-d33d-42a5-a262-b65472ea65e6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:38.529350 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6598bd2a-d33d-42a5-a262-b65472ea65e6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.255163 Aug 18 14:25:38.530021 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 51/96] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:38 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:38.546968 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eb2d9fab-d58c-4306-970f-5f802894d4d0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:38.548639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eb2d9fab-d58c-4306-970f-5f802894d4d0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:38.557542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb2d9fab-d58c-4306-970f-5f802894d4d0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:38.558939 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb2d9fab-d58c-4306-970f-5f802894d4d0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:38.559566 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb2d9fab-d58c-4306-970f-5f802894d4d0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:38.560613 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb2d9fab-d58c-4306-970f-5f802894d4d0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:38.561225 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb2d9fab-d58c-4306-970f-5f802894d4d0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:38.562254 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb2d9fab-d58c-4306-970f-5f802894d4d0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:38.642758 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f829fd2f-f87b-4311-a86c-fbbc2ed55b70 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:38.655481 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f829fd2f-f87b-4311-a86c-fbbc2ed55b70 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.202627 Aug 18 14:25:38.656076 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 46/97] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:38 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:25:38.721514 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-eb2d9fab-d58c-4306-970f-5f802894d4d0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:38.730082 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eb2d9fab-d58c-4306-970f-5f802894d4d0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.186891 Aug 18 14:25:38.730660 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 52/98] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:38 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:39.556603 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3b6d466c-6f4b-4509-a6a5-a6f31e1ec78f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:39.557581 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3b6d466c-6f4b-4509-a6a5-a6f31e1ec78f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:39.560152 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:25:39.567709 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b6d466c-6f4b-4509-a6a5-a6f31e1ec78f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:39.568374 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b6d466c-6f4b-4509-a6a5-a6f31e1ec78f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:39.568937 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b6d466c-6f4b-4509-a6a5-a6f31e1ec78f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:39.570034 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b6d466c-6f4b-4509-a6a5-a6f31e1ec78f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:39.570782 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b6d466c-6f4b-4509-a6a5-a6f31e1ec78f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:39.572403 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b6d466c-6f4b-4509-a6a5-a6f31e1ec78f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:39.676312 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6399ec7e-3ba4-49e9-b59f-bd5fc4df197f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:39.676935 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6399ec7e-3ba4-49e9-b59f-bd5fc4df197f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:39.687469 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6399ec7e-3ba4-49e9-b59f-bd5fc4df197f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:39.687969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6399ec7e-3ba4-49e9-b59f-bd5fc4df197f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:39.688411 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6399ec7e-3ba4-49e9-b59f-bd5fc4df197f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:39.689114 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6399ec7e-3ba4-49e9-b59f-bd5fc4df197f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:39.689743 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6399ec7e-3ba4-49e9-b59f-bd5fc4df197f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:39.690319 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6399ec7e-3ba4-49e9-b59f-bd5fc4df197f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:39.775631 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3b6d466c-6f4b-4509-a6a5-a6f31e1ec78f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:39.784893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3b6d466c-6f4b-4509-a6a5-a6f31e1ec78f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.235319 Aug 18 14:25:39.785899 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 47/99] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:39 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:39.791698 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a1ba5a8-0bcf-4cfe-bf02-29933e08177a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:39.792569 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0a1ba5a8-0bcf-4cfe-bf02-29933e08177a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:39.799026 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a1ba5a8-0bcf-4cfe-bf02-29933e08177a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:39.799884 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a1ba5a8-0bcf-4cfe-bf02-29933e08177a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:39.800741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a1ba5a8-0bcf-4cfe-bf02-29933e08177a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:39.801493 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a1ba5a8-0bcf-4cfe-bf02-29933e08177a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:39.802134 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a1ba5a8-0bcf-4cfe-bf02-29933e08177a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:39.802618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a1ba5a8-0bcf-4cfe-bf02-29933e08177a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:39.904727 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6399ec7e-3ba4-49e9-b59f-bd5fc4df197f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:39.913213 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6399ec7e-3ba4-49e9-b59f-bd5fc4df197f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.240763 Aug 18 14:25:39.915786 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 53/100] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:39 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:25:39.969958 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0a1ba5a8-0bcf-4cfe-bf02-29933e08177a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:39.979903 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a1ba5a8-0bcf-4cfe-bf02-29933e08177a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.192644 Aug 18 14:25:39.994116 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 48/101] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:39 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:40.825708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6498f8bb-3cc1-4881-a287-8a7634c5679f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:40.826450 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6498f8bb-3cc1-4881-a287-8a7634c5679f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:40.850321 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6498f8bb-3cc1-4881-a287-8a7634c5679f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:40.850817 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6498f8bb-3cc1-4881-a287-8a7634c5679f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:40.851258 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6498f8bb-3cc1-4881-a287-8a7634c5679f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:40.852060 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6498f8bb-3cc1-4881-a287-8a7634c5679f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:40.876191 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6498f8bb-3cc1-4881-a287-8a7634c5679f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:40.876742 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6498f8bb-3cc1-4881-a287-8a7634c5679f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:40.938729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-19297bf1-ccb3-44c8-82b1-6b8f803f063d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:40.940839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-19297bf1-ccb3-44c8-82b1-6b8f803f063d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:40.957421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19297bf1-ccb3-44c8-82b1-6b8f803f063d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:40.958305 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19297bf1-ccb3-44c8-82b1-6b8f803f063d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:40.959082 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19297bf1-ccb3-44c8-82b1-6b8f803f063d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:40.971338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19297bf1-ccb3-44c8-82b1-6b8f803f063d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:40.972478 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19297bf1-ccb3-44c8-82b1-6b8f803f063d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:40.973321 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19297bf1-ccb3-44c8-82b1-6b8f803f063d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:41.370992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6498f8bb-3cc1-4881-a287-8a7634c5679f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:41.382077 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6498f8bb-3cc1-4881-a287-8a7634c5679f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.572005 Aug 18 14:25:41.383577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 54/102] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:40 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:41.390104 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5ea62de0-21e0-4cb9-b6fc-b6f59dbb2ce1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:41.390974 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5ea62de0-21e0-4cb9-b6fc-b6f59dbb2ce1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:41.401953 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ea62de0-21e0-4cb9-b6fc-b6f59dbb2ce1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:41.404564 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ea62de0-21e0-4cb9-b6fc-b6f59dbb2ce1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:41.405950 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ea62de0-21e0-4cb9-b6fc-b6f59dbb2ce1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:41.408187 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ea62de0-21e0-4cb9-b6fc-b6f59dbb2ce1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:41.409348 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ea62de0-21e0-4cb9-b6fc-b6f59dbb2ce1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:41.411111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ea62de0-21e0-4cb9-b6fc-b6f59dbb2ce1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:41.506042 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-19297bf1-ccb3-44c8-82b1-6b8f803f063d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:41.516131 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-19297bf1-ccb3-44c8-82b1-6b8f803f063d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.582448 Aug 18 14:25:41.518650 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 49/103] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:40 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:41.769090 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5ea62de0-21e0-4cb9-b6fc-b6f59dbb2ce1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:41.777248 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5ea62de0-21e0-4cb9-b6fc-b6f59dbb2ce1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.391814 Aug 18 14:25:41.777821 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 55/104] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:41 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:42.403286 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-71ad4a75-15fa-4dea-b366-4283aa864173 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:42.403953 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-71ad4a75-15fa-4dea-b366-4283aa864173 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:42.410337 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71ad4a75-15fa-4dea-b366-4283aa864173 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:42.411016 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71ad4a75-15fa-4dea-b366-4283aa864173 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:42.411619 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71ad4a75-15fa-4dea-b366-4283aa864173 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:42.412482 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71ad4a75-15fa-4dea-b366-4283aa864173 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:42.413233 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71ad4a75-15fa-4dea-b366-4283aa864173 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:42.413841 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71ad4a75-15fa-4dea-b366-4283aa864173 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:42.542098 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1399e73c-1451-4133-8cb6-3c439af251be tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:42.542750 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1399e73c-1451-4133-8cb6-3c439af251be tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:42.549762 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1399e73c-1451-4133-8cb6-3c439af251be tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:42.550631 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1399e73c-1451-4133-8cb6-3c439af251be tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:42.551568 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1399e73c-1451-4133-8cb6-3c439af251be tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:42.552333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1399e73c-1451-4133-8cb6-3c439af251be tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:42.553220 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1399e73c-1451-4133-8cb6-3c439af251be tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:42.553863 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1399e73c-1451-4133-8cb6-3c439af251be tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:42.577545 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-71ad4a75-15fa-4dea-b366-4283aa864173 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:42.588993 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-71ad4a75-15fa-4dea-b366-4283aa864173 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.190092 Aug 18 14:25:42.590071 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 50/105] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:42 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:42.738149 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1399e73c-1451-4133-8cb6-3c439af251be tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:42.750530 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1399e73c-1451-4133-8cb6-3c439af251be tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.212022 Aug 18 14:25:42.751556 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 56/106] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:42 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:25:42.801470 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-07bd0929-45c6-4ab1-a8d3-64638ebfed84 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:42.802504 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-07bd0929-45c6-4ab1-a8d3-64638ebfed84 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:42.813107 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07bd0929-45c6-4ab1-a8d3-64638ebfed84 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:42.815665 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07bd0929-45c6-4ab1-a8d3-64638ebfed84 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:42.817930 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07bd0929-45c6-4ab1-a8d3-64638ebfed84 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:42.818679 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07bd0929-45c6-4ab1-a8d3-64638ebfed84 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:42.819296 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07bd0929-45c6-4ab1-a8d3-64638ebfed84 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:42.821309 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07bd0929-45c6-4ab1-a8d3-64638ebfed84 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:43.501694 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-07bd0929-45c6-4ab1-a8d3-64638ebfed84 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:43.509634 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-07bd0929-45c6-4ab1-a8d3-64638ebfed84 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.712455 Aug 18 14:25:43.512929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 51/107] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:42 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:43.611254 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d5e5adfa-39b3-4b67-88d3-bd87d37e6135 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:43.612440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d5e5adfa-39b3-4b67-88d3-bd87d37e6135 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:43.621554 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5e5adfa-39b3-4b67-88d3-bd87d37e6135 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:43.622220 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5e5adfa-39b3-4b67-88d3-bd87d37e6135 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:43.623593 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5e5adfa-39b3-4b67-88d3-bd87d37e6135 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:43.624703 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5e5adfa-39b3-4b67-88d3-bd87d37e6135 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:43.626201 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5e5adfa-39b3-4b67-88d3-bd87d37e6135 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:43.626920 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5e5adfa-39b3-4b67-88d3-bd87d37e6135 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:43.773663 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab1d9fd8-74a9-43fa-a35c-1250720fad2a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:43.775799 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab1d9fd8-74a9-43fa-a35c-1250720fad2a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:43.788913 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab1d9fd8-74a9-43fa-a35c-1250720fad2a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:43.789949 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab1d9fd8-74a9-43fa-a35c-1250720fad2a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:43.790578 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab1d9fd8-74a9-43fa-a35c-1250720fad2a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:43.791972 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab1d9fd8-74a9-43fa-a35c-1250720fad2a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:43.793400 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab1d9fd8-74a9-43fa-a35c-1250720fad2a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:43.794655 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab1d9fd8-74a9-43fa-a35c-1250720fad2a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:43.911628 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d5e5adfa-39b3-4b67-88d3-bd87d37e6135 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:43.932931 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d5e5adfa-39b3-4b67-88d3-bd87d37e6135 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.318544 Aug 18 14:25:43.934928 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 57/108] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:43 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:44.008009 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ab1d9fd8-74a9-43fa-a35c-1250720fad2a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:44.018475 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab1d9fd8-74a9-43fa-a35c-1250720fad2a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.250666 Aug 18 14:25:44.019524 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 52/109] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:43 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:25:44.533846 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-152192d1-6597-4323-9297-9d9e66312840 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:44.534208 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-152192d1-6597-4323-9297-9d9e66312840 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:44.541389 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-152192d1-6597-4323-9297-9d9e66312840 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:44.545870 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-152192d1-6597-4323-9297-9d9e66312840 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:44.546524 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-152192d1-6597-4323-9297-9d9e66312840 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:44.548084 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-152192d1-6597-4323-9297-9d9e66312840 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:44.548084 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-152192d1-6597-4323-9297-9d9e66312840 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:44.548273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-152192d1-6597-4323-9297-9d9e66312840 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:44.779121 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-152192d1-6597-4323-9297-9d9e66312840 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:44.788710 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-152192d1-6597-4323-9297-9d9e66312840 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.258939 Aug 18 14:25:44.789281 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 58/110] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:44 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:44.953383 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ee9f28a5-c878-47db-a243-1b388e2d5645 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:44.954618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ee9f28a5-c878-47db-a243-1b388e2d5645 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:44.962386 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee9f28a5-c878-47db-a243-1b388e2d5645 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:44.963087 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee9f28a5-c878-47db-a243-1b388e2d5645 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:44.963889 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee9f28a5-c878-47db-a243-1b388e2d5645 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:44.964908 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee9f28a5-c878-47db-a243-1b388e2d5645 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:44.965639 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee9f28a5-c878-47db-a243-1b388e2d5645 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:44.966655 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee9f28a5-c878-47db-a243-1b388e2d5645 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:45.047964 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f59bd9e5-c6de-40dc-9398-2d477fd32b91 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:45.048575 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f59bd9e5-c6de-40dc-9398-2d477fd32b91 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:45.097259 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f59bd9e5-c6de-40dc-9398-2d477fd32b91 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:45.097754 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f59bd9e5-c6de-40dc-9398-2d477fd32b91 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:45.102332 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f59bd9e5-c6de-40dc-9398-2d477fd32b91 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:45.103568 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f59bd9e5-c6de-40dc-9398-2d477fd32b91 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:45.105653 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f59bd9e5-c6de-40dc-9398-2d477fd32b91 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:45.106245 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f59bd9e5-c6de-40dc-9398-2d477fd32b91 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:45.140843 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ee9f28a5-c878-47db-a243-1b388e2d5645 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:45.158186 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ee9f28a5-c878-47db-a243-1b388e2d5645 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.208306 Aug 18 14:25:45.159453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 53/111] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:44 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:45.306684 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f59bd9e5-c6de-40dc-9398-2d477fd32b91 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:45.315438 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f59bd9e5-c6de-40dc-9398-2d477fd32b91 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.272868 Aug 18 14:25:45.316569 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 59/112] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:45 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:45.812362 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-023515a9-7c80-4d13-a62a-509f55408b6c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:45.813687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-023515a9-7c80-4d13-a62a-509f55408b6c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:45.820814 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023515a9-7c80-4d13-a62a-509f55408b6c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:45.821650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023515a9-7c80-4d13-a62a-509f55408b6c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:45.822664 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023515a9-7c80-4d13-a62a-509f55408b6c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:45.823737 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023515a9-7c80-4d13-a62a-509f55408b6c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:45.832997 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023515a9-7c80-4d13-a62a-509f55408b6c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:45.834297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023515a9-7c80-4d13-a62a-509f55408b6c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:45.976902 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-0c90a332-8238-4f96-bb1d-9cca1d3b19f9 req-c23fc36f-95d8-45e8-8a5d-8571d45991e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222bc1f0-96b3-4d29-960a-39437b4dc0a5", "name": "network-vif-plugged", "status": "completed", "tag": "23ad159c-abaf-411f-bb62-90941b33a93c"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:45.999387 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0c90a332-8238-4f96-bb1d-9cca1d3b19f9 req-c23fc36f-95d8-45e8-8a5d-8571d45991e5 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:45.999882 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0c90a332-8238-4f96-bb1d-9cca1d3b19f9 req-c23fc36f-95d8-45e8-8a5d-8571d45991e5 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:46.000320 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0c90a332-8238-4f96-bb1d-9cca1d3b19f9 req-c23fc36f-95d8-45e8-8a5d-8571d45991e5 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:46.043622 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-0c90a332-8238-4f96-bb1d-9cca1d3b19f9 req-c23fc36f-95d8-45e8-8a5d-8571d45991e5 service nova] Creating event network-vif-plugged:23ad159c-abaf-411f-bb62-90941b33a93c for instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 on hv-cinder-85220 Aug 18 14:25:46.058854 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-0c90a332-8238-4f96-bb1d-9cca1d3b19f9 req-c23fc36f-95d8-45e8-8a5d-8571d45991e5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.379358 Aug 18 14:25:46.060061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 54/113] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:46.089438 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-023515a9-7c80-4d13-a62a-509f55408b6c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:46.099394 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-023515a9-7c80-4d13-a62a-509f55408b6c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.293915 Aug 18 14:25:46.100195 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 60/114] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:45 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:46.182425 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ed65fd3e-76bd-4b78-8b0f-9c2a15042938 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:46.183538 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ed65fd3e-76bd-4b78-8b0f-9c2a15042938 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:46.191149 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed65fd3e-76bd-4b78-8b0f-9c2a15042938 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:46.191944 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed65fd3e-76bd-4b78-8b0f-9c2a15042938 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:46.192572 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed65fd3e-76bd-4b78-8b0f-9c2a15042938 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:46.193462 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed65fd3e-76bd-4b78-8b0f-9c2a15042938 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:46.194248 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed65fd3e-76bd-4b78-8b0f-9c2a15042938 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:46.194841 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed65fd3e-76bd-4b78-8b0f-9c2a15042938 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:46.341124 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f593e081-b198-441d-a22e-f5e120c384fb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:46.341884 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f593e081-b198-441d-a22e-f5e120c384fb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:46.348876 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f593e081-b198-441d-a22e-f5e120c384fb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:46.349595 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f593e081-b198-441d-a22e-f5e120c384fb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:46.350606 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f593e081-b198-441d-a22e-f5e120c384fb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:46.351896 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f593e081-b198-441d-a22e-f5e120c384fb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:46.352571 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f593e081-b198-441d-a22e-f5e120c384fb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:46.353584 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f593e081-b198-441d-a22e-f5e120c384fb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:46.353862 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ed65fd3e-76bd-4b78-8b0f-9c2a15042938 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:46.364526 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ed65fd3e-76bd-4b78-8b0f-9c2a15042938 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.186636 Aug 18 14:25:46.365303 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 55/115] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:46 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:46.524199 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f593e081-b198-441d-a22e-f5e120c384fb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:46.534178 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:25:46.540709 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f593e081-b198-441d-a22e-f5e120c384fb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.207080 Aug 18 14:25:46.541482 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 61/116] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:46 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:47.120672 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d2236357-045d-4bac-be32-bcbdf10852e8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:47.121303 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d2236357-045d-4bac-be32-bcbdf10852e8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:47.127728 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2236357-045d-4bac-be32-bcbdf10852e8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:47.128286 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2236357-045d-4bac-be32-bcbdf10852e8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:47.128798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2236357-045d-4bac-be32-bcbdf10852e8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:47.129494 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2236357-045d-4bac-be32-bcbdf10852e8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:47.129949 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2236357-045d-4bac-be32-bcbdf10852e8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:47.130373 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2236357-045d-4bac-be32-bcbdf10852e8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:47.279833 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d2236357-045d-4bac-be32-bcbdf10852e8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:47.287587 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d2236357-045d-4bac-be32-bcbdf10852e8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.170873 Aug 18 14:25:47.288153 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 56/117] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:47 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:47.386482 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5d75218a-65ad-4157-b05a-9d21d34953f6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:47.387101 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5d75218a-65ad-4157-b05a-9d21d34953f6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:47.393424 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d75218a-65ad-4157-b05a-9d21d34953f6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:47.393905 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d75218a-65ad-4157-b05a-9d21d34953f6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:47.394347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d75218a-65ad-4157-b05a-9d21d34953f6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:47.395269 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d75218a-65ad-4157-b05a-9d21d34953f6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:47.395505 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d75218a-65ad-4157-b05a-9d21d34953f6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:47.395928 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d75218a-65ad-4157-b05a-9d21d34953f6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:47.526638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5d75218a-65ad-4157-b05a-9d21d34953f6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:47.534417 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5d75218a-65ad-4157-b05a-9d21d34953f6 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.152493 Aug 18 14:25:47.534993 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 62/118] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:47 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:47.561734 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6a9bd678-a529-4d3f-853c-8c85dd71c0b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:47.562352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6a9bd678-a529-4d3f-853c-8c85dd71c0b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:47.568277 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a9bd678-a529-4d3f-853c-8c85dd71c0b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:47.568762 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a9bd678-a529-4d3f-853c-8c85dd71c0b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:47.569200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a9bd678-a529-4d3f-853c-8c85dd71c0b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:47.569889 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a9bd678-a529-4d3f-853c-8c85dd71c0b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:47.570345 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a9bd678-a529-4d3f-853c-8c85dd71c0b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:47.571327 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a9bd678-a529-4d3f-853c-8c85dd71c0b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:47.706586 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6a9bd678-a529-4d3f-853c-8c85dd71c0b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:47.715217 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6a9bd678-a529-4d3f-853c-8c85dd71c0b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.157236 Aug 18 14:25:47.715829 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 57/119] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:47 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:48.086135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-184edd55-4034-437a-8bc2-0f13a41a3335 req-73319d7a-859c-4ae8-a84c-fb3da8beca62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20af96f-d292-44e9-aa06-ab61a806780a", "name": "network-vif-plugged", "status": "completed", "tag": "050a7162-7214-4069-b7ab-6d6edbf76cbf"}, {"server_uuid": "5932e419-fd0d-407e-86bf-4855a74ea353", "name": "network-vif-plugged", "status": "completed", "tag": "7764691c-d09f-48e5-b6d6-986f0882a254"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:48.098976 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-184edd55-4034-437a-8bc2-0f13a41a3335 req-73319d7a-859c-4ae8-a84c-fb3da8beca62 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:48.099494 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-184edd55-4034-437a-8bc2-0f13a41a3335 req-73319d7a-859c-4ae8-a84c-fb3da8beca62 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:48.100107 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-184edd55-4034-437a-8bc2-0f13a41a3335 req-73319d7a-859c-4ae8-a84c-fb3da8beca62 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:48.114205 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-184edd55-4034-437a-8bc2-0f13a41a3335 req-73319d7a-859c-4ae8-a84c-fb3da8beca62 service nova] Creating event network-vif-plugged:050a7162-7214-4069-b7ab-6d6edbf76cbf for instance f20af96f-d292-44e9-aa06-ab61a806780a on hv-cinder-85220 Aug 18 14:25:48.115218 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-184edd55-4034-437a-8bc2-0f13a41a3335 req-73319d7a-859c-4ae8-a84c-fb3da8beca62 service nova] Creating event network-vif-plugged:7764691c-d09f-48e5-b6d6-986f0882a254 for instance 5932e419-fd0d-407e-86bf-4855a74ea353 on hv-cinder-85220 Aug 18 14:25:48.124382 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-184edd55-4034-437a-8bc2-0f13a41a3335 req-73319d7a-859c-4ae8-a84c-fb3da8beca62 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042649 Aug 18 14:25:48.125515 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 63/120] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:48.313064 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-21dab4ee-dcc1-40fb-80c2-b39166156710 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:48.316331 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-21dab4ee-dcc1-40fb-80c2-b39166156710 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:48.324407 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21dab4ee-dcc1-40fb-80c2-b39166156710 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:48.324955 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21dab4ee-dcc1-40fb-80c2-b39166156710 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:48.325708 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21dab4ee-dcc1-40fb-80c2-b39166156710 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:48.327010 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21dab4ee-dcc1-40fb-80c2-b39166156710 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:48.327712 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21dab4ee-dcc1-40fb-80c2-b39166156710 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:48.329061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21dab4ee-dcc1-40fb-80c2-b39166156710 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:48.530085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-21dab4ee-dcc1-40fb-80c2-b39166156710 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:48.538750 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-21dab4ee-dcc1-40fb-80c2-b39166156710 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.234488 Aug 18 14:25:48.539655 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 58/121] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:48 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:25:48.559084 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3b0ebec5-1f5a-4c8e-9fc8-23a45051ee7d tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:48.559821 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3b0ebec5-1f5a-4c8e-9fc8-23a45051ee7d tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:48.568892 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b0ebec5-1f5a-4c8e-9fc8-23a45051ee7d tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:48.574480 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b0ebec5-1f5a-4c8e-9fc8-23a45051ee7d tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:48.574924 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b0ebec5-1f5a-4c8e-9fc8-23a45051ee7d tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:48.575734 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b0ebec5-1f5a-4c8e-9fc8-23a45051ee7d tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:48.576430 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b0ebec5-1f5a-4c8e-9fc8-23a45051ee7d tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:48.576994 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b0ebec5-1f5a-4c8e-9fc8-23a45051ee7d tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:48.725515 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3b0ebec5-1f5a-4c8e-9fc8-23a45051ee7d tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:48.735119 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3b0ebec5-1f5a-4c8e-9fc8-23a45051ee7d tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.181447 Aug 18 14:25:48.737490 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 64/122] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:48 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:48.737661 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f6b5fa88-d410-4cb9-aef1-844ac98d5446 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:48.738619 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f6b5fa88-d410-4cb9-aef1-844ac98d5446 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:48.757467 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6b5fa88-d410-4cb9-aef1-844ac98d5446 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:48.757984 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6b5fa88-d410-4cb9-aef1-844ac98d5446 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:48.758990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6b5fa88-d410-4cb9-aef1-844ac98d5446 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:48.759734 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6b5fa88-d410-4cb9-aef1-844ac98d5446 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:48.760188 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6b5fa88-d410-4cb9-aef1-844ac98d5446 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:48.760615 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6b5fa88-d410-4cb9-aef1-844ac98d5446 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:48.766513 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:25:49.004554 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f6b5fa88-d410-4cb9-aef1-844ac98d5446 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:49.014521 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f6b5fa88-d410-4cb9-aef1-844ac98d5446 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.281187 Aug 18 14:25:49.024018 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 59/123] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:48 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:25:49.564189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d68eef09-ee89-4d49-b6a6-b2a869af4b16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:49.564877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d68eef09-ee89-4d49-b6a6-b2a869af4b16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:49.571089 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d68eef09-ee89-4d49-b6a6-b2a869af4b16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:49.571550 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d68eef09-ee89-4d49-b6a6-b2a869af4b16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:49.571980 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d68eef09-ee89-4d49-b6a6-b2a869af4b16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:49.572668 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d68eef09-ee89-4d49-b6a6-b2a869af4b16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:49.573117 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d68eef09-ee89-4d49-b6a6-b2a869af4b16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:49.573540 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d68eef09-ee89-4d49-b6a6-b2a869af4b16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:49.714213 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d68eef09-ee89-4d49-b6a6-b2a869af4b16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:49.723587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d68eef09-ee89-4d49-b6a6-b2a869af4b16 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.163164 Aug 18 14:25:49.724158 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 65/124] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:49 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:49.759263 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8e614d4d-58cc-48c4-bf98-a70c47a17c85 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:49.759942 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8e614d4d-58cc-48c4-bf98-a70c47a17c85 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:49.765978 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e614d4d-58cc-48c4-bf98-a70c47a17c85 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:49.766470 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e614d4d-58cc-48c4-bf98-a70c47a17c85 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:49.766904 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e614d4d-58cc-48c4-bf98-a70c47a17c85 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:49.767627 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e614d4d-58cc-48c4-bf98-a70c47a17c85 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:49.768083 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e614d4d-58cc-48c4-bf98-a70c47a17c85 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:49.768508 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e614d4d-58cc-48c4-bf98-a70c47a17c85 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:49.909117 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8e614d4d-58cc-48c4-bf98-a70c47a17c85 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:49.918882 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8e614d4d-58cc-48c4-bf98-a70c47a17c85 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.164023 Aug 18 14:25:49.919489 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 60/125] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:49 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:50.037837 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d290c495-9337-4637-aadc-1fe3137dad96 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:50.038752 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d290c495-9337-4637-aadc-1fe3137dad96 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:50.045041 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d290c495-9337-4637-aadc-1fe3137dad96 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:50.045525 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d290c495-9337-4637-aadc-1fe3137dad96 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:50.049022 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d290c495-9337-4637-aadc-1fe3137dad96 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:50.049022 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d290c495-9337-4637-aadc-1fe3137dad96 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:50.049022 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d290c495-9337-4637-aadc-1fe3137dad96 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:50.049022 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d290c495-9337-4637-aadc-1fe3137dad96 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:50.144479 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-f737951f-2673-4b59-984a-838bb23d1345 req-429792b4-63e7-4f2d-89f5-764cce90e1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed05a0ad-3aad-4113-b8b3-8daa97e04f2f", "name": "network-vif-plugged", "status": "completed", "tag": "4de21cfe-6345-4dbd-890d-aa61bf0849bf"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:50.156958 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-f737951f-2673-4b59-984a-838bb23d1345 req-429792b4-63e7-4f2d-89f5-764cce90e1ab service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:50.157680 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-f737951f-2673-4b59-984a-838bb23d1345 req-429792b4-63e7-4f2d-89f5-764cce90e1ab service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:50.158566 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-f737951f-2673-4b59-984a-838bb23d1345 req-429792b4-63e7-4f2d-89f5-764cce90e1ab service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:50.175464 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-f737951f-2673-4b59-984a-838bb23d1345 req-429792b4-63e7-4f2d-89f5-764cce90e1ab service nova] Creating event network-vif-plugged:4de21cfe-6345-4dbd-890d-aa61bf0849bf for instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f on hv-cinder-85220 Aug 18 14:25:50.188908 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-f737951f-2673-4b59-984a-838bb23d1345 req-429792b4-63e7-4f2d-89f5-764cce90e1ab service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042902 Aug 18 14:25:50.190033 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 61/126] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:25:50.244006 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d290c495-9337-4637-aadc-1fe3137dad96 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:50.258839 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d290c495-9337-4637-aadc-1fe3137dad96 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1320 microversion: 2.1 time: 0.224223 Aug 18 14:25:50.275681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 66/127] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:50 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1320 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:50.747732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1815a628-66e3-4061-a0b7-68107e4352ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:50.749429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1815a628-66e3-4061-a0b7-68107e4352ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:50.785690 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1815a628-66e3-4061-a0b7-68107e4352ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:50.788548 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1815a628-66e3-4061-a0b7-68107e4352ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:50.790492 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1815a628-66e3-4061-a0b7-68107e4352ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:50.793764 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1815a628-66e3-4061-a0b7-68107e4352ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:50.796049 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1815a628-66e3-4061-a0b7-68107e4352ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:50.800097 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1815a628-66e3-4061-a0b7-68107e4352ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:50.944383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f749961a-58a2-4119-aa01-d4d4ff8650cb tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:50.945159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f749961a-58a2-4119-aa01-d4d4ff8650cb tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:50.958174 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f749961a-58a2-4119-aa01-d4d4ff8650cb tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:50.958952 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f749961a-58a2-4119-aa01-d4d4ff8650cb tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:50.960931 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f749961a-58a2-4119-aa01-d4d4ff8650cb tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:50.962553 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f749961a-58a2-4119-aa01-d4d4ff8650cb tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:50.963031 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f749961a-58a2-4119-aa01-d4d4ff8650cb tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:50.964023 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f749961a-58a2-4119-aa01-d4d4ff8650cb tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:51.111566 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1815a628-66e3-4061-a0b7-68107e4352ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:51.125881 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1815a628-66e3-4061-a0b7-68107e4352ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.384391 Aug 18 14:25:51.126441 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 62/128] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:50 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:51.192397 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f749961a-58a2-4119-aa01-d4d4ff8650cb tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:51.203206 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f749961a-58a2-4119-aa01-d4d4ff8650cb tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1314 microversion: 2.1 time: 0.264971 Aug 18 14:25:51.217686 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 67/129] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:50 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:51.281430 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5b835af7-51eb-4d4b-8691-1f60b40246ce tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:51.282065 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5b835af7-51eb-4d4b-8691-1f60b40246ce tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:51.296658 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b835af7-51eb-4d4b-8691-1f60b40246ce tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:51.297192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b835af7-51eb-4d4b-8691-1f60b40246ce tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:51.297642 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b835af7-51eb-4d4b-8691-1f60b40246ce tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:51.302016 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b835af7-51eb-4d4b-8691-1f60b40246ce tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:51.302494 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b835af7-51eb-4d4b-8691-1f60b40246ce tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:51.304030 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b835af7-51eb-4d4b-8691-1f60b40246ce tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:51.518329 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5b835af7-51eb-4d4b-8691-1f60b40246ce tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:51.530268 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5b835af7-51eb-4d4b-8691-1f60b40246ce tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1513 microversion: 2.1 time: 0.253261 Aug 18 14:25:51.535235 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 63/130] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:51 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:51.558315 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fbaa22e3-9cf1-4c95-bda8-003170041614 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:51.560413 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fbaa22e3-9cf1-4c95-bda8-003170041614 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:51.567359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbaa22e3-9cf1-4c95-bda8-003170041614 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:51.567941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbaa22e3-9cf1-4c95-bda8-003170041614 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:51.568599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbaa22e3-9cf1-4c95-bda8-003170041614 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:51.569677 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbaa22e3-9cf1-4c95-bda8-003170041614 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:51.570409 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbaa22e3-9cf1-4c95-bda8-003170041614 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:51.571398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbaa22e3-9cf1-4c95-bda8-003170041614 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:51.642686 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-fbaa22e3-9cf1-4c95-bda8-003170041614 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lazy-loading 'flavor' on Instance uuid 5932e419-fd0d-407e-86bf-4855a74ea353 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:25:51.847534 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fbaa22e3-9cf1-4c95-bda8-003170041614 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "POST /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353/action" status: 200 len: 32 microversion: 2.1 time: 0.294065 Aug 18 14:25:51.848203 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 68/131] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:25:51 2022] POST /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353/action => generated 32 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:25:51.860576 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fabcdfae-8295-4f2e-b550-f28a849a55b9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:51.861374 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fabcdfae-8295-4f2e-b550-f28a849a55b9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:51.869939 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fabcdfae-8295-4f2e-b550-f28a849a55b9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:51.871132 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fabcdfae-8295-4f2e-b550-f28a849a55b9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:51.871984 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fabcdfae-8295-4f2e-b550-f28a849a55b9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:51.872937 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fabcdfae-8295-4f2e-b550-f28a849a55b9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:51.873543 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fabcdfae-8295-4f2e-b550-f28a849a55b9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:51.874164 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fabcdfae-8295-4f2e-b550-f28a849a55b9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:52.151036 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-35f67c15-138d-4eba-a585-f6628fd3d41f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:52.151766 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-35f67c15-138d-4eba-a585-f6628fd3d41f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:52.162391 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35f67c15-138d-4eba-a585-f6628fd3d41f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:52.162894 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35f67c15-138d-4eba-a585-f6628fd3d41f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:52.163320 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35f67c15-138d-4eba-a585-f6628fd3d41f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:52.164049 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35f67c15-138d-4eba-a585-f6628fd3d41f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:52.164578 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35f67c15-138d-4eba-a585-f6628fd3d41f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:52.164954 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35f67c15-138d-4eba-a585-f6628fd3d41f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:52.287218 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fabcdfae-8295-4f2e-b550-f28a849a55b9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:52.304577 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fabcdfae-8295-4f2e-b550-f28a849a55b9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.441676 Aug 18 14:25:52.306838 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 64/132] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:51 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:52.315002 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6406898c-1ae7-4161-a671-1d71b826f4bc tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:52.316051 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6406898c-1ae7-4161-a671-1d71b826f4bc tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:52.325176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6406898c-1ae7-4161-a671-1d71b826f4bc tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:52.326425 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6406898c-1ae7-4161-a671-1d71b826f4bc tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:52.327538 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6406898c-1ae7-4161-a671-1d71b826f4bc tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:52.329690 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6406898c-1ae7-4161-a671-1d71b826f4bc tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:52.330342 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6406898c-1ae7-4161-a671-1d71b826f4bc tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:52.331001 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6406898c-1ae7-4161-a671-1d71b826f4bc tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:52.613228 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-35f67c15-138d-4eba-a585-f6628fd3d41f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:52.624642 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-35f67c15-138d-4eba-a585-f6628fd3d41f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.477690 Aug 18 14:25:52.626846 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 69/133] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:52 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:52.775746 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6406898c-1ae7-4161-a671-1d71b826f4bc tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:52.794928 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6406898c-1ae7-4161-a671-1d71b826f4bc tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1500 microversion: 2.1 time: 0.486608 Aug 18 14:25:52.796845 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 65/134] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:52 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1500 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:53.334116 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2d483697-826d-44ec-bd0b-c639322806e3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:53.334746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2d483697-826d-44ec-bd0b-c639322806e3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:53.351142 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d483697-826d-44ec-bd0b-c639322806e3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:53.352675 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d483697-826d-44ec-bd0b-c639322806e3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:53.353201 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d483697-826d-44ec-bd0b-c639322806e3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:53.353898 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d483697-826d-44ec-bd0b-c639322806e3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:53.357288 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d483697-826d-44ec-bd0b-c639322806e3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:53.357834 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d483697-826d-44ec-bd0b-c639322806e3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:53.577456 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2d483697-826d-44ec-bd0b-c639322806e3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:53.591715 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2d483697-826d-44ec-bd0b-c639322806e3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.265420 Aug 18 14:25:53.605793 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 70/135] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:53 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:53.651008 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-967f4469-030b-4ebe-87b1-650a407fa990 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:53.651711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-967f4469-030b-4ebe-87b1-650a407fa990 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:53.658502 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-967f4469-030b-4ebe-87b1-650a407fa990 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:53.658986 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-967f4469-030b-4ebe-87b1-650a407fa990 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:53.659625 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-967f4469-030b-4ebe-87b1-650a407fa990 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:53.660532 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-967f4469-030b-4ebe-87b1-650a407fa990 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:53.660985 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-967f4469-030b-4ebe-87b1-650a407fa990 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:53.661405 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-967f4469-030b-4ebe-87b1-650a407fa990 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:53.843835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-967f4469-030b-4ebe-87b1-650a407fa990 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:53.864665 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-967f4469-030b-4ebe-87b1-650a407fa990 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1367 microversion: 2.1 time: 0.219939 Aug 18 14:25:53.865320 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 66/136] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:53 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:54.512733 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-71652166-c406-40d6-85c4-cc1cc9a6641a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36b3b427-9bb2-4c89-b905-021061b72ca8"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:54.515277 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-71652166-c406-40d6-85c4-cc1cc9a6641a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:54.523014 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71652166-c406-40d6-85c4-cc1cc9a6641a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:54.523792 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71652166-c406-40d6-85c4-cc1cc9a6641a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:54.524445 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71652166-c406-40d6-85c4-cc1cc9a6641a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:54.525156 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71652166-c406-40d6-85c4-cc1cc9a6641a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:54.525763 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71652166-c406-40d6-85c4-cc1cc9a6641a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:54.526203 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71652166-c406-40d6-85c4-cc1cc9a6641a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:54.613055 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c6eeeef3-5b67-44f6-952a-09e023271d24 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:54.614463 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c6eeeef3-5b67-44f6-952a-09e023271d24 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:54.626294 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6eeeef3-5b67-44f6-952a-09e023271d24 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:54.628731 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6eeeef3-5b67-44f6-952a-09e023271d24 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:54.629553 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6eeeef3-5b67-44f6-952a-09e023271d24 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:54.631590 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6eeeef3-5b67-44f6-952a-09e023271d24 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:54.634188 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6eeeef3-5b67-44f6-952a-09e023271d24 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:54.634710 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6eeeef3-5b67-44f6-952a-09e023271d24 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:54.856634 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c6eeeef3-5b67-44f6-952a-09e023271d24 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:54.865570 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c6eeeef3-5b67-44f6-952a-09e023271d24 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.256204 Aug 18 14:25:54.866465 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 67/137] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:54 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:54.886094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-71ffbc95-3e91-410b-8beb-0ae8345faf9d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:54.886893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-71ffbc95-3e91-410b-8beb-0ae8345faf9d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:54.892882 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71ffbc95-3e91-410b-8beb-0ae8345faf9d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:54.893414 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71ffbc95-3e91-410b-8beb-0ae8345faf9d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:54.894076 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71ffbc95-3e91-410b-8beb-0ae8345faf9d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:54.894746 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71ffbc95-3e91-410b-8beb-0ae8345faf9d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:54.895195 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71ffbc95-3e91-410b-8beb-0ae8345faf9d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:54.895788 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71ffbc95-3e91-410b-8beb-0ae8345faf9d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:55.042658 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-71652166-c406-40d6-85c4-cc1cc9a6641a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "POST /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533475 Aug 18 14:25:55.044339 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 71/138] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:25:54 2022] POST /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a/os-volume_attachments => generated 194 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:55.075917 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-71ffbc95-3e91-410b-8beb-0ae8345faf9d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:55.092517 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-71ffbc95-3e91-410b-8beb-0ae8345faf9d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1556 microversion: 2.1 time: 0.210569 Aug 18 14:25:55.093107 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 68/139] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:54 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1556 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:25:55.118227 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-de50af4b-d78e-4440-b2eb-9e16ad89833c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:55.119117 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-de50af4b-d78e-4440-b2eb-9e16ad89833c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:55.126073 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de50af4b-d78e-4440-b2eb-9e16ad89833c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:55.126842 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de50af4b-d78e-4440-b2eb-9e16ad89833c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:55.127635 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de50af4b-d78e-4440-b2eb-9e16ad89833c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:55.128578 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de50af4b-d78e-4440-b2eb-9e16ad89833c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:55.129220 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de50af4b-d78e-4440-b2eb-9e16ad89833c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:55.129835 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de50af4b-d78e-4440-b2eb-9e16ad89833c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:55.250240 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-de50af4b-d78e-4440-b2eb-9e16ad89833c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138254 Aug 18 14:25:55.251006 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 72/140] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Aug 18 14:25:55 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:55.889838 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-78a1af45-f65c-46ad-adb1-f618271f4d35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:55.890464 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-78a1af45-f65c-46ad-adb1-f618271f4d35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:55.899881 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78a1af45-f65c-46ad-adb1-f618271f4d35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:55.900388 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78a1af45-f65c-46ad-adb1-f618271f4d35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:55.900832 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78a1af45-f65c-46ad-adb1-f618271f4d35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:55.907719 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78a1af45-f65c-46ad-adb1-f618271f4d35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:55.908651 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78a1af45-f65c-46ad-adb1-f618271f4d35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:55.909428 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78a1af45-f65c-46ad-adb1-f618271f4d35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:56.123574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-78a1af45-f65c-46ad-adb1-f618271f4d35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:56.136528 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-78a1af45-f65c-46ad-adb1-f618271f4d35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.250791 Aug 18 14:25:56.137431 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 69/141] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:55 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:57.060428 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-61e8523a-1a38-4194-b9be-c29ac955de8a req-9ae141f1-0b87-4188-aea2-91986d8533e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed05a0ad-3aad-4113-b8b3-8daa97e04f2f", "tag": "4de21cfe-6345-4dbd-890d-aa61bf0849bf"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:25:57.081163 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-61e8523a-1a38-4194-b9be-c29ac955de8a req-9ae141f1-0b87-4188-aea2-91986d8533e0 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:57.081707 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-61e8523a-1a38-4194-b9be-c29ac955de8a req-9ae141f1-0b87-4188-aea2-91986d8533e0 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:57.084929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-61e8523a-1a38-4194-b9be-c29ac955de8a req-9ae141f1-0b87-4188-aea2-91986d8533e0 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:57.109772 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-61e8523a-1a38-4194-b9be-c29ac955de8a req-9ae141f1-0b87-4188-aea2-91986d8533e0 service nova] Creating event network-changed:4de21cfe-6345-4dbd-890d-aa61bf0849bf for instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f on hv-cinder-85220 Aug 18 14:25:57.116929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-61e8523a-1a38-4194-b9be-c29ac955de8a req-9ae141f1-0b87-4188-aea2-91986d8533e0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061616 Aug 18 14:25:57.117381 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 73/142] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:25:57.158398 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-71afed9d-e350-4b4c-b282-2c472a899f0b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:57.159131 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-71afed9d-e350-4b4c-b282-2c472a899f0b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:57.172971 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71afed9d-e350-4b4c-b282-2c472a899f0b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:57.173924 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71afed9d-e350-4b4c-b282-2c472a899f0b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:57.175350 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71afed9d-e350-4b4c-b282-2c472a899f0b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:57.177851 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71afed9d-e350-4b4c-b282-2c472a899f0b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:57.178474 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71afed9d-e350-4b4c-b282-2c472a899f0b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:57.179061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71afed9d-e350-4b4c-b282-2c472a899f0b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:57.520597 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-71afed9d-e350-4b4c-b282-2c472a899f0b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:57.530077 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-71afed9d-e350-4b4c-b282-2c472a899f0b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.376016 Aug 18 14:25:57.533133 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 70/143] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:57 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:58.556207 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2987b785-1f2d-4f09-acf9-f3b4669bd383 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:58.557510 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2987b785-1f2d-4f09-acf9-f3b4669bd383 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:58.565787 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2987b785-1f2d-4f09-acf9-f3b4669bd383 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:58.566274 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2987b785-1f2d-4f09-acf9-f3b4669bd383 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:58.566709 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2987b785-1f2d-4f09-acf9-f3b4669bd383 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:58.573330 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2987b785-1f2d-4f09-acf9-f3b4669bd383 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:58.573817 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2987b785-1f2d-4f09-acf9-f3b4669bd383 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:58.574259 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2987b785-1f2d-4f09-acf9-f3b4669bd383 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:58.777858 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2987b785-1f2d-4f09-acf9-f3b4669bd383 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:25:58.790096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2987b785-1f2d-4f09-acf9-f3b4669bd383 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.239678 Aug 18 14:25:58.791173 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 74/144] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:58 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:25:59.812038 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9c58f007-da19-4c27-b6ff-baad9d55087e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:25:59.813235 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9c58f007-da19-4c27-b6ff-baad9d55087e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:25:59.822085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c58f007-da19-4c27-b6ff-baad9d55087e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:59.823530 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c58f007-da19-4c27-b6ff-baad9d55087e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:59.824131 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c58f007-da19-4c27-b6ff-baad9d55087e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:25:59.825520 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c58f007-da19-4c27-b6ff-baad9d55087e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:25:59.826122 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c58f007-da19-4c27-b6ff-baad9d55087e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:25:59.826695 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c58f007-da19-4c27-b6ff-baad9d55087e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:00.050861 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9c58f007-da19-4c27-b6ff-baad9d55087e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:00.062650 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9c58f007-da19-4c27-b6ff-baad9d55087e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.255538 Aug 18 14:26:00.077084 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 71/145] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:25:59 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:01.089265 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a1f53e65-94e0-4758-b4dd-4dd849b228d7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:01.090014 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a1f53e65-94e0-4758-b4dd-4dd849b228d7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:01.104907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1f53e65-94e0-4758-b4dd-4dd849b228d7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:01.105847 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1f53e65-94e0-4758-b4dd-4dd849b228d7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:01.106529 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1f53e65-94e0-4758-b4dd-4dd849b228d7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:01.108284 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1f53e65-94e0-4758-b4dd-4dd849b228d7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:01.109195 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1f53e65-94e0-4758-b4dd-4dd849b228d7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:01.109915 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1f53e65-94e0-4758-b4dd-4dd849b228d7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:01.325759 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a1f53e65-94e0-4758-b4dd-4dd849b228d7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:01.341507 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a1f53e65-94e0-4758-b4dd-4dd849b228d7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.258845 Aug 18 14:26:01.343453 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 75/146] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:01 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:02.372396 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eaf9c783-1ca3-4186-b379-5797223adad1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:02.375932 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eaf9c783-1ca3-4186-b379-5797223adad1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:02.401909 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaf9c783-1ca3-4186-b379-5797223adad1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:02.402587 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaf9c783-1ca3-4186-b379-5797223adad1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:02.403132 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaf9c783-1ca3-4186-b379-5797223adad1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:02.404429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaf9c783-1ca3-4186-b379-5797223adad1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:02.406311 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaf9c783-1ca3-4186-b379-5797223adad1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:02.409260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaf9c783-1ca3-4186-b379-5797223adad1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:02.578764 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eaf9c783-1ca3-4186-b379-5797223adad1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:02.587941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eaf9c783-1ca3-4186-b379-5797223adad1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.224347 Aug 18 14:26:02.588966 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 72/147] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:02 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:03.190229 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-901ddc83-d271-43d9-a0e8-e788b76204e1 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:03.190746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-901ddc83-d271-43d9-a0e8-e788b76204e1 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:03.197593 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=62 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:03.198999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-901ddc83-d271-43d9-a0e8-e788b76204e1 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:03.199626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-901ddc83-d271-43d9-a0e8-e788b76204e1 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:03.200339 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-901ddc83-d271-43d9-a0e8-e788b76204e1 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:03.201180 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-901ddc83-d271-43d9-a0e8-e788b76204e1 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:03.201943 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-901ddc83-d271-43d9-a0e8-e788b76204e1 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:03.202503 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-901ddc83-d271-43d9-a0e8-e788b76204e1 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:03.235552 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-901ddc83-d271-43d9-a0e8-e788b76204e1 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:26:03.248046 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:03.431258 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-901ddc83-d271-43d9-a0e8-e788b76204e1 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 204 len: 0 microversion: 2.1 time: 0.244802 Aug 18 14:26:03.432358 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 76/148] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:26:03 2022] DELETE /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:26:03.442225 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7e58ab6e-f1ac-4b2c-80c7-02b6be527ec8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:03.443741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7e58ab6e-f1ac-4b2c-80c7-02b6be527ec8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:03.452462 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e58ab6e-f1ac-4b2c-80c7-02b6be527ec8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:03.453670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e58ab6e-f1ac-4b2c-80c7-02b6be527ec8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:03.454362 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e58ab6e-f1ac-4b2c-80c7-02b6be527ec8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:03.455277 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e58ab6e-f1ac-4b2c-80c7-02b6be527ec8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:03.457110 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e58ab6e-f1ac-4b2c-80c7-02b6be527ec8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:03.457740 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e58ab6e-f1ac-4b2c-80c7-02b6be527ec8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:03.611355 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0f071c08-300b-4ca2-91d1-20819e66f32e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:03.612758 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0f071c08-300b-4ca2-91d1-20819e66f32e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:03.618341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7e58ab6e-f1ac-4b2c-80c7-02b6be527ec8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:03.621894 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f071c08-300b-4ca2-91d1-20819e66f32e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:03.622694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f071c08-300b-4ca2-91d1-20819e66f32e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:03.623667 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f071c08-300b-4ca2-91d1-20819e66f32e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:03.624897 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f071c08-300b-4ca2-91d1-20819e66f32e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:03.625715 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f071c08-300b-4ca2-91d1-20819e66f32e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:03.626411 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f071c08-300b-4ca2-91d1-20819e66f32e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:03.628168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7e58ab6e-f1ac-4b2c-80c7-02b6be527ec8 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1552 microversion: 2.1 time: 0.191569 Aug 18 14:26:03.628860 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 73/149] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:03 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1552 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:03.822729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0f071c08-300b-4ca2-91d1-20819e66f32e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:03.832030 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0f071c08-300b-4ca2-91d1-20819e66f32e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.225540 Aug 18 14:26:03.833714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 77/150] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:03 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:04.653827 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e4672172-6538-4ead-b886-8c4c9ba37c38 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:04.655641 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e4672172-6538-4ead-b886-8c4c9ba37c38 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:04.662359 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4672172-6538-4ead-b886-8c4c9ba37c38 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:04.663088 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4672172-6538-4ead-b886-8c4c9ba37c38 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:04.664692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4672172-6538-4ead-b886-8c4c9ba37c38 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:04.665690 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4672172-6538-4ead-b886-8c4c9ba37c38 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:04.666213 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4672172-6538-4ead-b886-8c4c9ba37c38 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:04.666701 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4672172-6538-4ead-b886-8c4c9ba37c38 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:04.815023 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e4672172-6538-4ead-b886-8c4c9ba37c38 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:04.825524 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e4672172-6538-4ead-b886-8c4c9ba37c38 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1552 microversion: 2.1 time: 0.176048 Aug 18 14:26:04.826209 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 74/151] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:04 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1552 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:04.855419 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8d6e168e-6f63-4d0f-bc86-134b08c40b7c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:04.855885 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8d6e168e-6f63-4d0f-bc86-134b08c40b7c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:04.862425 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d6e168e-6f63-4d0f-bc86-134b08c40b7c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:04.862910 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d6e168e-6f63-4d0f-bc86-134b08c40b7c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:04.863346 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d6e168e-6f63-4d0f-bc86-134b08c40b7c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:04.864059 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d6e168e-6f63-4d0f-bc86-134b08c40b7c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:04.864515 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d6e168e-6f63-4d0f-bc86-134b08c40b7c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:04.864939 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d6e168e-6f63-4d0f-bc86-134b08c40b7c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:05.020420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8d6e168e-6f63-4d0f-bc86-134b08c40b7c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:05.034360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8d6e168e-6f63-4d0f-bc86-134b08c40b7c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.184524 Aug 18 14:26:05.035031 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 78/152] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:04 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:05.847232 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e5f2c9e0-f777-40a8-a380-9fa8922c365c tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:05.847887 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e5f2c9e0-f777-40a8-a380-9fa8922c365c tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:05.854469 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5f2c9e0-f777-40a8-a380-9fa8922c365c tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:05.854946 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5f2c9e0-f777-40a8-a380-9fa8922c365c tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:05.855393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5f2c9e0-f777-40a8-a380-9fa8922c365c tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:05.856093 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5f2c9e0-f777-40a8-a380-9fa8922c365c tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:05.856545 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5f2c9e0-f777-40a8-a380-9fa8922c365c tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:05.856968 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5f2c9e0-f777-40a8-a380-9fa8922c365c tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:05.990283 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e5f2c9e0-f777-40a8-a380-9fa8922c365c tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:06.001321 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e5f2c9e0-f777-40a8-a380-9fa8922c365c tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1552 microversion: 2.1 time: 0.158067 Aug 18 14:26:06.001966 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 75/153] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:05 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:06.058550 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cda77ac0-0e02-4c55-a3df-2e08427a2707 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:06.059692 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cda77ac0-0e02-4c55-a3df-2e08427a2707 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:06.067933 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cda77ac0-0e02-4c55-a3df-2e08427a2707 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:06.068418 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cda77ac0-0e02-4c55-a3df-2e08427a2707 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:06.068848 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cda77ac0-0e02-4c55-a3df-2e08427a2707 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:06.069533 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cda77ac0-0e02-4c55-a3df-2e08427a2707 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:06.070011 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cda77ac0-0e02-4c55-a3df-2e08427a2707 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:06.070442 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cda77ac0-0e02-4c55-a3df-2e08427a2707 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:06.198292 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cda77ac0-0e02-4c55-a3df-2e08427a2707 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:06.206639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cda77ac0-0e02-4c55-a3df-2e08427a2707 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.153975 Aug 18 14:26:06.207201 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 79/154] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:06 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:07.022099 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b2ae840f-940f-44e8-bd59-07e0bbfc380a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:07.022770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b2ae840f-940f-44e8-bd59-07e0bbfc380a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:07.028875 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2ae840f-940f-44e8-bd59-07e0bbfc380a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:07.029339 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2ae840f-940f-44e8-bd59-07e0bbfc380a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:07.029893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2ae840f-940f-44e8-bd59-07e0bbfc380a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:07.030545 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2ae840f-940f-44e8-bd59-07e0bbfc380a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:07.031007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2ae840f-940f-44e8-bd59-07e0bbfc380a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:07.031472 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2ae840f-940f-44e8-bd59-07e0bbfc380a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:07.049548 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:07.162145 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b2ae840f-940f-44e8-bd59-07e0bbfc380a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:07.170965 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b2ae840f-940f-44e8-bd59-07e0bbfc380a tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1552 microversion: 2.1 time: 0.152790 Aug 18 14:26:07.171553 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 76/155] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:07 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:07.228370 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1334d23c-13b9-404c-a6c6-243f5d707222 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:07.229006 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1334d23c-13b9-404c-a6c6-243f5d707222 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:07.235756 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1334d23c-13b9-404c-a6c6-243f5d707222 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:07.236242 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1334d23c-13b9-404c-a6c6-243f5d707222 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:07.236676 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1334d23c-13b9-404c-a6c6-243f5d707222 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:07.237387 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1334d23c-13b9-404c-a6c6-243f5d707222 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:07.237838 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1334d23c-13b9-404c-a6c6-243f5d707222 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:07.238261 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1334d23c-13b9-404c-a6c6-243f5d707222 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:07.374007 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1334d23c-13b9-404c-a6c6-243f5d707222 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:07.382505 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1334d23c-13b9-404c-a6c6-243f5d707222 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.158442 Aug 18 14:26:07.383086 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 80/156] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:07 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:08.192303 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d9a1cd75-0bad-4a7d-bc1f-57a5b169846f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:08.192920 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d9a1cd75-0bad-4a7d-bc1f-57a5b169846f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:08.194766 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=65 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:08.200829 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9a1cd75-0bad-4a7d-bc1f-57a5b169846f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:08.201239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9a1cd75-0bad-4a7d-bc1f-57a5b169846f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:08.201669 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9a1cd75-0bad-4a7d-bc1f-57a5b169846f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:08.202359 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9a1cd75-0bad-4a7d-bc1f-57a5b169846f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:08.202810 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9a1cd75-0bad-4a7d-bc1f-57a5b169846f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:08.203232 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9a1cd75-0bad-4a7d-bc1f-57a5b169846f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:08.405522 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-36b6c71b-9442-407d-a9e8-21d1de9233d8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:08.406800 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-36b6c71b-9442-407d-a9e8-21d1de9233d8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:08.413019 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36b6c71b-9442-407d-a9e8-21d1de9233d8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:08.413505 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36b6c71b-9442-407d-a9e8-21d1de9233d8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:08.413938 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36b6c71b-9442-407d-a9e8-21d1de9233d8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:08.418494 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d9a1cd75-0bad-4a7d-bc1f-57a5b169846f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:08.423012 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36b6c71b-9442-407d-a9e8-21d1de9233d8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:08.423785 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36b6c71b-9442-407d-a9e8-21d1de9233d8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:08.424226 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36b6c71b-9442-407d-a9e8-21d1de9233d8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:08.442315 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d9a1cd75-0bad-4a7d-bc1f-57a5b169846f tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1552 microversion: 2.1 time: 0.253746 Aug 18 14:26:08.443145 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 77/157] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:08 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1552 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:08.697587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-36b6c71b-9442-407d-a9e8-21d1de9233d8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:08.705742 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-36b6c71b-9442-407d-a9e8-21d1de9233d8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.304441 Aug 18 14:26:08.706367 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 81/158] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:08 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:08.910949 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-3a3e3ab8-bf25-442d-9015-6688106ad61f req-143de59f-3b88-4076-97b4-95fbe3a427e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f20af96f-d292-44e9-aa06-ab61a806780a", "name": "network-vif-deleted", "tag": "050a7162-7214-4069-b7ab-6d6edbf76cbf"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:08.922893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-3a3e3ab8-bf25-442d-9015-6688106ad61f req-143de59f-3b88-4076-97b4-95fbe3a427e9 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:08.923610 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-3a3e3ab8-bf25-442d-9015-6688106ad61f req-143de59f-3b88-4076-97b4-95fbe3a427e9 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:08.924202 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-3a3e3ab8-bf25-442d-9015-6688106ad61f req-143de59f-3b88-4076-97b4-95fbe3a427e9 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:08.937647 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-3a3e3ab8-bf25-442d-9015-6688106ad61f req-143de59f-3b88-4076-97b4-95fbe3a427e9 service nova] Creating event network-vif-deleted:050a7162-7214-4069-b7ab-6d6edbf76cbf for instance f20af96f-d292-44e9-aa06-ab61a806780a on hv-cinder-85220 Aug 18 14:26:08.943208 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-3a3e3ab8-bf25-442d-9015-6688106ad61f req-143de59f-3b88-4076-97b4-95fbe3a427e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036000 Aug 18 14:26:08.944015 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 78/159] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:26:09.463723 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ad395284-c72d-46d9-9ed9-2abd1df1f097 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:09.464337 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ad395284-c72d-46d9-9ed9-2abd1df1f097 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:09.470541 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad395284-c72d-46d9-9ed9-2abd1df1f097 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:09.471014 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad395284-c72d-46d9-9ed9-2abd1df1f097 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:09.471542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad395284-c72d-46d9-9ed9-2abd1df1f097 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:09.472221 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad395284-c72d-46d9-9ed9-2abd1df1f097 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:09.472675 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad395284-c72d-46d9-9ed9-2abd1df1f097 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:09.473086 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad395284-c72d-46d9-9ed9-2abd1df1f097 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:09.543924 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ad395284-c72d-46d9-9ed9-2abd1df1f097 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:09.552978 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ad395284-c72d-46d9-9ed9-2abd1df1f097 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1510 microversion: 2.1 time: 0.093287 Aug 18 14:26:09.553540 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 82/160] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:09 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1510 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:09.728543 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-98402905-7db2-4b80-bd15-a89709c2a5a5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:09.729559 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-98402905-7db2-4b80-bd15-a89709c2a5a5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:09.736025 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98402905-7db2-4b80-bd15-a89709c2a5a5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:09.736504 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98402905-7db2-4b80-bd15-a89709c2a5a5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:09.736930 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98402905-7db2-4b80-bd15-a89709c2a5a5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:09.737612 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98402905-7db2-4b80-bd15-a89709c2a5a5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:09.738056 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98402905-7db2-4b80-bd15-a89709c2a5a5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:09.738470 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98402905-7db2-4b80-bd15-a89709c2a5a5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:09.885642 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-98402905-7db2-4b80-bd15-a89709c2a5a5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:09.893897 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-98402905-7db2-4b80-bd15-a89709c2a5a5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.170218 Aug 18 14:26:09.894541 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 79/161] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:09 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:10.574367 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-58540693-ed55-4379-8501-8e3f4f2a2c14 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:10.575100 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-58540693-ed55-4379-8501-8e3f4f2a2c14 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:10.582237 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58540693-ed55-4379-8501-8e3f4f2a2c14 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:10.582801 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58540693-ed55-4379-8501-8e3f4f2a2c14 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:10.583309 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58540693-ed55-4379-8501-8e3f4f2a2c14 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:10.584104 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58540693-ed55-4379-8501-8e3f4f2a2c14 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:10.584634 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58540693-ed55-4379-8501-8e3f4f2a2c14 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:10.585131 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58540693-ed55-4379-8501-8e3f4f2a2c14 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:10.666392 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-58540693-ed55-4379-8501-8e3f4f2a2c14 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:10.674623 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-58540693-ed55-4379-8501-8e3f4f2a2c14 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1510 microversion: 2.1 time: 0.104445 Aug 18 14:26:10.675185 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 83/162] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:10 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1510 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:10.917832 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-91d6cada-bfb6-4a52-8f58-fe20851c1ec9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:10.918612 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-91d6cada-bfb6-4a52-8f58-fe20851c1ec9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:10.925883 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91d6cada-bfb6-4a52-8f58-fe20851c1ec9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:10.926534 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91d6cada-bfb6-4a52-8f58-fe20851c1ec9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:10.927072 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91d6cada-bfb6-4a52-8f58-fe20851c1ec9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:10.928135 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91d6cada-bfb6-4a52-8f58-fe20851c1ec9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:10.929059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91d6cada-bfb6-4a52-8f58-fe20851c1ec9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:10.929553 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91d6cada-bfb6-4a52-8f58-fe20851c1ec9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:11.091014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-91d6cada-bfb6-4a52-8f58-fe20851c1ec9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:11.105658 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-91d6cada-bfb6-4a52-8f58-fe20851c1ec9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.193870 Aug 18 14:26:11.106327 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 80/163] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:10 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:11.698274 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-24b13ddb-7f7e-42a0-8182-4472301c3f95 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:11.699067 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-24b13ddb-7f7e-42a0-8182-4472301c3f95 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:11.705729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24b13ddb-7f7e-42a0-8182-4472301c3f95 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:11.706302 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24b13ddb-7f7e-42a0-8182-4472301c3f95 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:11.706738 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24b13ddb-7f7e-42a0-8182-4472301c3f95 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:11.707461 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24b13ddb-7f7e-42a0-8182-4472301c3f95 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:11.707918 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24b13ddb-7f7e-42a0-8182-4472301c3f95 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:11.708344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24b13ddb-7f7e-42a0-8182-4472301c3f95 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:11.786114 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-24b13ddb-7f7e-42a0-8182-4472301c3f95 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c875db4d43e47f986d5a9168813ed95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8637cffaecaf4fd58439bf1362d1bdd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:11.812575 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-24b13ddb-7f7e-42a0-8182-4472301c3f95 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 200 len: 1345 microversion: 2.1 time: 0.110921 Aug 18 14:26:11.813687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 84/164] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:11 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 1345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:12.130525 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ef8d8613-3999-41ec-ab60-13f81df6f006 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:12.131154 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ef8d8613-3999-41ec-ab60-13f81df6f006 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:12.142833 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef8d8613-3999-41ec-ab60-13f81df6f006 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:12.143350 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef8d8613-3999-41ec-ab60-13f81df6f006 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:12.143986 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef8d8613-3999-41ec-ab60-13f81df6f006 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:12.144784 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef8d8613-3999-41ec-ab60-13f81df6f006 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:12.145307 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef8d8613-3999-41ec-ab60-13f81df6f006 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:12.145793 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef8d8613-3999-41ec-ab60-13f81df6f006 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:12.458565 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ef8d8613-3999-41ec-ab60-13f81df6f006 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:12.468782 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ef8d8613-3999-41ec-ab60-13f81df6f006 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.342194 Aug 18 14:26:12.469693 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 81/165] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:12 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:12.838809 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-63289a11-e127-4761-b7c1-a965ee8f1967 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:12.839584 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-63289a11-e127-4761-b7c1-a965ee8f1967 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:12.853557 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63289a11-e127-4761-b7c1-a965ee8f1967 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:12.855432 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63289a11-e127-4761-b7c1-a965ee8f1967 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:12.856329 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63289a11-e127-4761-b7c1-a965ee8f1967 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:12.857825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63289a11-e127-4761-b7c1-a965ee8f1967 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:12.858602 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63289a11-e127-4761-b7c1-a965ee8f1967 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:12.859258 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63289a11-e127-4761-b7c1-a965ee8f1967 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:12.890443 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-63289a11-e127-4761-b7c1-a965ee8f1967 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] HTTP exception thrown: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-63289a11-e127-4761-b7c1-a965ee8f1967 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Request method failure captured: Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a HTTP/1.1 Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvBWPyXVoCA5cSLxSXKdlMyOHUZnOfWbyxMpRpoiy7t3T5haWqxNAo5vP8-tymOigLEh-onRKCkGS6jTle6tnlvqMWkrW1demctlANPsfad-eoKaYEpSoESdrduYzwiIR0vMj0uOfHHXvtBobmADVs3XrkgPepG7rlvCcvX-8iEO6A Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 8637cffaecaf4fd58439bf1362d1bdd5 Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-DeleteServersTestJSON-2041142462 Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:26:12.895639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:26:12.897472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:26:12.897472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-DeleteServersTestJSON-2041142462 Aug 18 14:26:12.897472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 8637cffaecaf4fd58439bf1362d1bdd5 Aug 18 14:26:12.897472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-DeleteServersTestJSON-2041142462 Aug 18 14:26:12.897472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-DeleteServersTestJSON-2041142462-project Aug 18 14:26:12.897472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:26:12.897472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:26:12.897472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 4c875db4d43e47f986d5a9168813ed95 Aug 18 14:26:12.897472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-DeleteServersTestJSON-2041142462-project Aug 18 14:26:12.897472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:26:12.897472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:12.897472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': 'f20af96f-d292-44e9-aa06-ab61a806780a'} Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:26:12.898626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:12.901255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:26:12.903852 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-63289a11-e127-4761-b7c1-a965ee8f1967 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Returning 404 to user: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:26:12.903852 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-63289a11-e127-4761-b7c1-a965ee8f1967 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 404 len: 111 microversion: 2.1 time: 0.071396 Aug 18 14:26:12.903852 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 85/166] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:12 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:26:13.073932 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f899d6cc-6782-4fad-a3c8-05cc7f95b796 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:13.076170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f899d6cc-6782-4fad-a3c8-05cc7f95b796 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:13.082173 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f899d6cc-6782-4fad-a3c8-05cc7f95b796 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:13.082953 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f899d6cc-6782-4fad-a3c8-05cc7f95b796 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:13.083290 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f899d6cc-6782-4fad-a3c8-05cc7f95b796 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:13.084036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f899d6cc-6782-4fad-a3c8-05cc7f95b796 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:13.084493 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f899d6cc-6782-4fad-a3c8-05cc7f95b796 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:13.084969 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f899d6cc-6782-4fad-a3c8-05cc7f95b796 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:13.131137 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-f899d6cc-6782-4fad-a3c8-05cc7f95b796 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] HTTP exception thrown: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f899d6cc-6782-4fad-a3c8-05cc7f95b796 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Request method failure captured: Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a/os-volume_attachments HTTP/1.1 Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvBWPyXVoCA5cSLxSXKdlMyOHUZnOfWbyxMpRpoiy7t3T5haWqxNAo5vP8-tymOigLEh-onRKCkGS6jTle6tnlvqMWkrW1demctlANPsfad-eoKaYEpSoESdrduYzwiIR0vMj0uOfHHXvtBobmADVs3XrkgPepG7rlvCcvX-8iEO6A Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 8637cffaecaf4fd58439bf1362d1bdd5 Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-DeleteServersTestJSON-2041142462 Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:26:13.136310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:26:13.137824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:26:13.137824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-DeleteServersTestJSON-2041142462 Aug 18 14:26:13.137824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 8637cffaecaf4fd58439bf1362d1bdd5 Aug 18 14:26:13.137824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-DeleteServersTestJSON-2041142462 Aug 18 14:26:13.137824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-DeleteServersTestJSON-2041142462-project Aug 18 14:26:13.137824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:26:13.137824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:26:13.137824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 4c875db4d43e47f986d5a9168813ed95 Aug 18 14:26:13.137824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-DeleteServersTestJSON-2041142462-project Aug 18 14:26:13.137824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:26:13.137824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:13.137824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'server_id': 'f20af96f-d292-44e9-aa06-ab61a806780a'} Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:26:13.138828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:13.141094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:13.144681 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f899d6cc-6782-4fad-a3c8-05cc7f95b796 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Returning 404 to user: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:26:13.144681 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f899d6cc-6782-4fad-a3c8-05cc7f95b796 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.068535 Aug 18 14:26:13.144681 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 82/167] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:26:13 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a/os-volume_attachments => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:26:13.490416 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3f985f95-8849-4193-ad8f-b192e737de7b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:13.491063 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3f985f95-8849-4193-ad8f-b192e737de7b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:13.501137 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f985f95-8849-4193-ad8f-b192e737de7b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:13.501948 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f985f95-8849-4193-ad8f-b192e737de7b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:13.502506 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f985f95-8849-4193-ad8f-b192e737de7b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:13.503625 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f985f95-8849-4193-ad8f-b192e737de7b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:13.504240 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f985f95-8849-4193-ad8f-b192e737de7b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:13.504899 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f985f95-8849-4193-ad8f-b192e737de7b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:13.681481 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3f985f95-8849-4193-ad8f-b192e737de7b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:13.689684 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3f985f95-8849-4193-ad8f-b192e737de7b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.203122 Aug 18 14:26:13.690970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 86/168] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:13 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:14.463342 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-386920da-71ce-4e1f-b987-7b0353e6f303 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:14.464462 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-386920da-71ce-4e1f-b987-7b0353e6f303 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:14.493642 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-386920da-71ce-4e1f-b987-7b0353e6f303 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:14.495425 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-386920da-71ce-4e1f-b987-7b0353e6f303 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:14.500768 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-386920da-71ce-4e1f-b987-7b0353e6f303 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:14.501792 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-386920da-71ce-4e1f-b987-7b0353e6f303 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:14.502499 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-386920da-71ce-4e1f-b987-7b0353e6f303 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:14.503032 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-386920da-71ce-4e1f-b987-7b0353e6f303 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:14.536099 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-386920da-71ce-4e1f-b987-7b0353e6f303 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] HTTP exception thrown: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-386920da-71ce-4e1f-b987-7b0353e6f303 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Request method failure captured: Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a HTTP/1.1 Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvBWPyXVoCA5cSLxSXKdlMyOHUZnOfWbyxMpRpoiy7t3T5haWqxNAo5vP8-tymOigLEh-onRKCkGS6jTle6tnlvqMWkrW1demctlANPsfad-eoKaYEpSoESdrduYzwiIR0vMj0uOfHHXvtBobmADVs3XrkgPepG7rlvCcvX-8iEO6A Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 8637cffaecaf4fd58439bf1362d1bdd5 Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-DeleteServersTestJSON-2041142462 Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:26:14.543614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:26:14.545109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:26:14.545109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-DeleteServersTestJSON-2041142462 Aug 18 14:26:14.545109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 8637cffaecaf4fd58439bf1362d1bdd5 Aug 18 14:26:14.545109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-DeleteServersTestJSON-2041142462 Aug 18 14:26:14.545109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-DeleteServersTestJSON-2041142462-project Aug 18 14:26:14.545109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:26:14.545109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:26:14.545109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 4c875db4d43e47f986d5a9168813ed95 Aug 18 14:26:14.545109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-DeleteServersTestJSON-2041142462-project Aug 18 14:26:14.545109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:26:14.545109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:14.545109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': 'f20af96f-d292-44e9-aa06-ab61a806780a'} Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:26:14.546109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:14.547451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:14.551293 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-386920da-71ce-4e1f-b987-7b0353e6f303 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Returning 404 to user: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:26:14.553167 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-386920da-71ce-4e1f-b987-7b0353e6f303 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 404 len: 111 microversion: 2.1 time: 0.095670 Aug 18 14:26:14.556556 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 83/169] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:26:14 2022] DELETE /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:26:14.565564 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-728e8e40-ea43-4936-bea6-e3f5f4e67413 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:14.566189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-728e8e40-ea43-4936-bea6-e3f5f4e67413 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] [instance: f20af96f-d292-44e9-aa06-ab61a806780a] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:14.576549 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-728e8e40-ea43-4936-bea6-e3f5f4e67413 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:14.578782 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-728e8e40-ea43-4936-bea6-e3f5f4e67413 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:14.579494 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-728e8e40-ea43-4936-bea6-e3f5f4e67413 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:14.580235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-728e8e40-ea43-4936-bea6-e3f5f4e67413 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:14.582737 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-728e8e40-ea43-4936-bea6-e3f5f4e67413 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:14.583386 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-728e8e40-ea43-4936-bea6-e3f5f4e67413 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:14.626660 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-728e8e40-ea43-4936-bea6-e3f5f4e67413 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] HTTP exception thrown: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-728e8e40-ea43-4936-bea6-e3f5f4e67413 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Request method failure captured: Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a HTTP/1.1 Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvBWPyXVoCA5cSLxSXKdlMyOHUZnOfWbyxMpRpoiy7t3T5haWqxNAo5vP8-tymOigLEh-onRKCkGS6jTle6tnlvqMWkrW1demctlANPsfad-eoKaYEpSoESdrduYzwiIR0vMj0uOfHHXvtBobmADVs3XrkgPepG7rlvCcvX-8iEO6A Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 8637cffaecaf4fd58439bf1362d1bdd5 Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-DeleteServersTestJSON-2041142462 Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:26:14.628778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:26:14.629929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8637cffaecaf4fd58439bf1362d1bdd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:26:14.629929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-DeleteServersTestJSON-2041142462 Aug 18 14:26:14.629929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 8637cffaecaf4fd58439bf1362d1bdd5 Aug 18 14:26:14.629929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-DeleteServersTestJSON-2041142462 Aug 18 14:26:14.629929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-DeleteServersTestJSON-2041142462-project Aug 18 14:26:14.629929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:26:14.629929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:26:14.629929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 4c875db4d43e47f986d5a9168813ed95 Aug 18 14:26:14.629929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-DeleteServersTestJSON-2041142462-project Aug 18 14:26:14.629929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:26:14.629929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:14.629929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': 'f20af96f-d292-44e9-aa06-ab61a806780a'} Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:26:14.630577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. Aug 18 14:26:14.631900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:26:14.632965 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-728e8e40-ea43-4936-bea6-e3f5f4e67413 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] Returning 404 to user: Instance f20af96f-d292-44e9-aa06-ab61a806780a could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:26:14.632965 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-728e8e40-ea43-4936-bea6-e3f5f4e67413 tempest-DeleteServersTestJSON-2041142462 tempest-DeleteServersTestJSON-2041142462-project] 10.222.0.39 "GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a" status: 404 len: 111 microversion: 2.1 time: 0.069165 Aug 18 14:26:14.632965 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 87/170] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:14 2022] GET /compute/v2.1/servers/f20af96f-d292-44e9-aa06-ab61a806780a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:26:14.715055 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ec0fda87-3728-4a6b-ab08-def7ae00d9b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:14.718426 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ec0fda87-3728-4a6b-ab08-def7ae00d9b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:14.733472 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec0fda87-3728-4a6b-ab08-def7ae00d9b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:14.734278 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec0fda87-3728-4a6b-ab08-def7ae00d9b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:14.734873 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec0fda87-3728-4a6b-ab08-def7ae00d9b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:14.735917 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec0fda87-3728-4a6b-ab08-def7ae00d9b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:14.736416 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec0fda87-3728-4a6b-ab08-def7ae00d9b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:14.737004 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec0fda87-3728-4a6b-ab08-def7ae00d9b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:15.026291 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ec0fda87-3728-4a6b-ab08-def7ae00d9b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:15.038036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ec0fda87-3728-4a6b-ab08-def7ae00d9b7 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.329638 Aug 18 14:26:15.039463 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 84/171] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:14 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:16.061017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5c534f8f-3ea4-4aaa-843c-620de8435fae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:16.062638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5c534f8f-3ea4-4aaa-843c-620de8435fae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:16.070414 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c534f8f-3ea4-4aaa-843c-620de8435fae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:16.070639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c534f8f-3ea4-4aaa-843c-620de8435fae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:16.071958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c534f8f-3ea4-4aaa-843c-620de8435fae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:16.072833 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c534f8f-3ea4-4aaa-843c-620de8435fae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:16.073297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c534f8f-3ea4-4aaa-843c-620de8435fae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:16.073727 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c534f8f-3ea4-4aaa-843c-620de8435fae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:16.285118 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5c534f8f-3ea4-4aaa-843c-620de8435fae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:16.295829 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5c534f8f-3ea4-4aaa-843c-620de8435fae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.238453 Aug 18 14:26:16.296824 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 88/172] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:16 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:17.319549 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-741d23b4-e035-4738-b819-0f07c7a5e757 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:17.320172 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-741d23b4-e035-4738-b819-0f07c7a5e757 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:17.332086 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-741d23b4-e035-4738-b819-0f07c7a5e757 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:17.333041 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-741d23b4-e035-4738-b819-0f07c7a5e757 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:17.336314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-741d23b4-e035-4738-b819-0f07c7a5e757 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:17.337343 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-741d23b4-e035-4738-b819-0f07c7a5e757 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:17.338669 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-741d23b4-e035-4738-b819-0f07c7a5e757 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:17.340565 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-741d23b4-e035-4738-b819-0f07c7a5e757 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:17.554816 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-741d23b4-e035-4738-b819-0f07c7a5e757 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:17.573336 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-741d23b4-e035-4738-b819-0f07c7a5e757 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.257506 Aug 18 14:26:17.573920 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 85/173] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:17 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:18.597777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7af07bbb-02b8-4f60-a145-dbeeac40298e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:18.598587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7af07bbb-02b8-4f60-a145-dbeeac40298e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:18.609786 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7af07bbb-02b8-4f60-a145-dbeeac40298e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:18.610315 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7af07bbb-02b8-4f60-a145-dbeeac40298e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:18.610923 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7af07bbb-02b8-4f60-a145-dbeeac40298e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:18.612043 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7af07bbb-02b8-4f60-a145-dbeeac40298e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:18.612506 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7af07bbb-02b8-4f60-a145-dbeeac40298e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:18.612936 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7af07bbb-02b8-4f60-a145-dbeeac40298e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:18.867084 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7af07bbb-02b8-4f60-a145-dbeeac40298e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:18.876730 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7af07bbb-02b8-4f60-a145-dbeeac40298e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.284655 Aug 18 14:26:18.877406 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 89/174] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:18 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:19.250819 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1208992450", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "networks": [{"uuid": "be329242-7c49-4d4f-bd52-60f3795ae90b"}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:19.325570 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] validate_networks() for [('be329242-7c49-4d4f-bd52-60f3795ae90b', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:26:19.897925 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1d30b69d-4464-4cd7-ac2f-f468676f7c44 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:19.898566 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1d30b69d-4464-4cd7-ac2f-f468676f7c44 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:19.907276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d30b69d-4464-4cd7-ac2f-f468676f7c44 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:19.907794 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d30b69d-4464-4cd7-ac2f-f468676f7c44 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:19.908222 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d30b69d-4464-4cd7-ac2f-f468676f7c44 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:19.908911 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d30b69d-4464-4cd7-ac2f-f468676f7c44 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:19.909368 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d30b69d-4464-4cd7-ac2f-f468676f7c44 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:19.910685 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d30b69d-4464-4cd7-ac2f-f468676f7c44 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:20.030632 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:26:20.031239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:26:20.031755 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:26:20.032219 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:26:20.032789 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:26:20.043491 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:20.044038 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:20.044429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:20.045141 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:20.045589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:20.046182 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:20.064587 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Getting quotas for project a8c8f3970f01483b84fce0859a219c84. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:26:20.068646 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Getting quotas for user 278dd42fb0264c44b7926fb9d1ff46c0 and project a8c8f3970f01483b84fce0859a219c84. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:26:20.080267 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:26:20.081260 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1d30b69d-4464-4cd7-ac2f-f468676f7c44 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:20.082714 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:26:20.089824 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1d30b69d-4464-4cd7-ac2f-f468676f7c44 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.195677 Aug 18 14:26:20.090485 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 90/175] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:19 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:20.141020 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d1578e60-0dd4-4a60-a15d-b9fc17de8f3a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894002 Aug 18 14:26:20.142785 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 86/176] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:26:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:26:20.156686 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b6d30cf9-b9ea-4baf-833b-9d789dc0a8e4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:20.157469 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b6d30cf9-b9ea-4baf-833b-9d789dc0a8e4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:20.235721 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b6d30cf9-b9ea-4baf-833b-9d789dc0a8e4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:20.246509 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b6d30cf9-b9ea-4baf-833b-9d789dc0a8e4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1214 microversion: 2.1 time: 0.093574 Aug 18 14:26:20.248349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 91/177] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:20 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:21.114328 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5c57b59b-5fdb-4a33-950f-6e5331cba8bd tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:21.115056 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5c57b59b-5fdb-4a33-950f-6e5331cba8bd tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:21.123156 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c57b59b-5fdb-4a33-950f-6e5331cba8bd tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:21.123696 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c57b59b-5fdb-4a33-950f-6e5331cba8bd tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:21.124170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c57b59b-5fdb-4a33-950f-6e5331cba8bd tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:21.124833 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c57b59b-5fdb-4a33-950f-6e5331cba8bd tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:21.125285 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c57b59b-5fdb-4a33-950f-6e5331cba8bd tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:21.125728 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c57b59b-5fdb-4a33-950f-6e5331cba8bd tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:21.268564 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8fcbcee5-6012-404a-a95f-8826007071c1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:21.269347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8fcbcee5-6012-404a-a95f-8826007071c1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:21.277647 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8fcbcee5-6012-404a-a95f-8826007071c1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:21.278212 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8fcbcee5-6012-404a-a95f-8826007071c1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:21.278710 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8fcbcee5-6012-404a-a95f-8826007071c1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:21.279529 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8fcbcee5-6012-404a-a95f-8826007071c1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:21.280045 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8fcbcee5-6012-404a-a95f-8826007071c1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:21.281077 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8fcbcee5-6012-404a-a95f-8826007071c1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:21.317569 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5c57b59b-5fdb-4a33-950f-6e5331cba8bd tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:21.328730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5c57b59b-5fdb-4a33-950f-6e5331cba8bd tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.218939 Aug 18 14:26:21.329993 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 87/178] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:21 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:21.369617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8fcbcee5-6012-404a-a95f-8826007071c1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:21.378025 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8fcbcee5-6012-404a-a95f-8826007071c1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1218 microversion: 2.1 time: 0.113436 Aug 18 14:26:21.378645 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 92/179] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:21 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:22.350987 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5069f11d-551d-40cb-b06a-32e9e4bd688f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:22.353429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5069f11d-551d-40cb-b06a-32e9e4bd688f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:22.361819 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5069f11d-551d-40cb-b06a-32e9e4bd688f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:22.364756 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5069f11d-551d-40cb-b06a-32e9e4bd688f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:22.365208 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5069f11d-551d-40cb-b06a-32e9e4bd688f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:22.366041 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5069f11d-551d-40cb-b06a-32e9e4bd688f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:22.366526 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5069f11d-551d-40cb-b06a-32e9e4bd688f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:22.366952 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5069f11d-551d-40cb-b06a-32e9e4bd688f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:22.400347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b3eb5fba-a7ef-4338-b883-149db5772111 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:22.401624 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b3eb5fba-a7ef-4338-b883-149db5772111 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:22.409001 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3eb5fba-a7ef-4338-b883-149db5772111 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:22.409844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3eb5fba-a7ef-4338-b883-149db5772111 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:22.410373 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3eb5fba-a7ef-4338-b883-149db5772111 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:22.411175 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3eb5fba-a7ef-4338-b883-149db5772111 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:22.411654 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3eb5fba-a7ef-4338-b883-149db5772111 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:22.412331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3eb5fba-a7ef-4338-b883-149db5772111 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:22.490446 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b3eb5fba-a7ef-4338-b883-149db5772111 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:22.499876 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b3eb5fba-a7ef-4338-b883-149db5772111 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1274 microversion: 2.1 time: 0.104081 Aug 18 14:26:22.502501 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 93/180] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:22 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:22.788019 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5069f11d-551d-40cb-b06a-32e9e4bd688f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:22.806745 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5069f11d-551d-40cb-b06a-32e9e4bd688f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.460115 Aug 18 14:26:22.808141 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 88/181] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:22 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:23.525851 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8a764e2b-d87e-4d04-9ff8-cf310be5314a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:23.526754 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8a764e2b-d87e-4d04-9ff8-cf310be5314a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:23.534409 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a764e2b-d87e-4d04-9ff8-cf310be5314a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:23.535008 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a764e2b-d87e-4d04-9ff8-cf310be5314a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:23.535541 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a764e2b-d87e-4d04-9ff8-cf310be5314a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:23.536476 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a764e2b-d87e-4d04-9ff8-cf310be5314a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:23.537028 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a764e2b-d87e-4d04-9ff8-cf310be5314a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:23.537672 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a764e2b-d87e-4d04-9ff8-cf310be5314a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:23.545593 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:23.627722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8a764e2b-d87e-4d04-9ff8-cf310be5314a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:23.638120 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8a764e2b-d87e-4d04-9ff8-cf310be5314a tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1272 microversion: 2.1 time: 0.119004 Aug 18 14:26:23.638710 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 94/182] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:23 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1272 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:23.827208 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-78a00b03-cf50-44c2-878e-0a475adb6a5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:23.827900 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-78a00b03-cf50-44c2-878e-0a475adb6a5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:23.834930 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78a00b03-cf50-44c2-878e-0a475adb6a5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:23.835498 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78a00b03-cf50-44c2-878e-0a475adb6a5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:23.835943 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78a00b03-cf50-44c2-878e-0a475adb6a5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:23.836831 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78a00b03-cf50-44c2-878e-0a475adb6a5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:23.837677 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78a00b03-cf50-44c2-878e-0a475adb6a5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:23.838285 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78a00b03-cf50-44c2-878e-0a475adb6a5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:24.163240 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-78a00b03-cf50-44c2-878e-0a475adb6a5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:24.183878 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-78a00b03-cf50-44c2-878e-0a475adb6a5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.360456 Aug 18 14:26:24.184692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 89/183] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:23 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:24.659482 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cba68b27-f14a-4a73-b6eb-0c37693d08f4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:24.660085 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cba68b27-f14a-4a73-b6eb-0c37693d08f4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:24.668211 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cba68b27-f14a-4a73-b6eb-0c37693d08f4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:24.668696 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cba68b27-f14a-4a73-b6eb-0c37693d08f4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:24.669318 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cba68b27-f14a-4a73-b6eb-0c37693d08f4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:24.670009 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cba68b27-f14a-4a73-b6eb-0c37693d08f4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:24.670655 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cba68b27-f14a-4a73-b6eb-0c37693d08f4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:24.671172 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cba68b27-f14a-4a73-b6eb-0c37693d08f4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:24.851695 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cba68b27-f14a-4a73-b6eb-0c37693d08f4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:24.863797 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cba68b27-f14a-4a73-b6eb-0c37693d08f4 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1314 microversion: 2.1 time: 0.207712 Aug 18 14:26:24.864917 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 95/184] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:24 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:25.212984 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9a97c7d8-21c6-49e1-a433-3d0f5403c484 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:25.232116 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9a97c7d8-21c6-49e1-a433-3d0f5403c484 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:25.256462 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a97c7d8-21c6-49e1-a433-3d0f5403c484 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:25.257029 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a97c7d8-21c6-49e1-a433-3d0f5403c484 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:25.260100 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a97c7d8-21c6-49e1-a433-3d0f5403c484 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:25.261409 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a97c7d8-21c6-49e1-a433-3d0f5403c484 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:25.261942 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a97c7d8-21c6-49e1-a433-3d0f5403c484 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:25.262389 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a97c7d8-21c6-49e1-a433-3d0f5403c484 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:25.557087 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9a97c7d8-21c6-49e1-a433-3d0f5403c484 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:25.571877 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9a97c7d8-21c6-49e1-a433-3d0f5403c484 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.369273 Aug 18 14:26:25.573232 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 90/185] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:25 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:25.696639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-edfef256-d624-42a9-aad4-91f082900330 req-3fb20300-966a-4e52-b4f8-3ccdb6b2b58b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0c83fc-46e8-4ea0-ba6b-d28270f344f5", "tag": "c05a1310-a2bb-41fd-9f42-4609512b399d"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:25.717482 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-edfef256-d624-42a9-aad4-91f082900330 req-3fb20300-966a-4e52-b4f8-3ccdb6b2b58b service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:25.718250 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-edfef256-d624-42a9-aad4-91f082900330 req-3fb20300-966a-4e52-b4f8-3ccdb6b2b58b service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:25.719105 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-edfef256-d624-42a9-aad4-91f082900330 req-3fb20300-966a-4e52-b4f8-3ccdb6b2b58b service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:25.732894 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-edfef256-d624-42a9-aad4-91f082900330 req-3fb20300-966a-4e52-b4f8-3ccdb6b2b58b service nova] Creating event network-changed:c05a1310-a2bb-41fd-9f42-4609512b399d for instance 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 on hv-cinder-85220 Aug 18 14:26:25.738354 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-edfef256-d624-42a9-aad4-91f082900330 req-3fb20300-966a-4e52-b4f8-3ccdb6b2b58b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046073 Aug 18 14:26:25.739193 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 96/186] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:26:25.887543 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b6891278-24f3-4828-afaa-dba41052a916 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:25.888256 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b6891278-24f3-4828-afaa-dba41052a916 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:25.895063 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6891278-24f3-4828-afaa-dba41052a916 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:25.895727 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6891278-24f3-4828-afaa-dba41052a916 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:25.896252 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6891278-24f3-4828-afaa-dba41052a916 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:25.897376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6891278-24f3-4828-afaa-dba41052a916 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:25.899621 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6891278-24f3-4828-afaa-dba41052a916 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:25.899621 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6891278-24f3-4828-afaa-dba41052a916 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:26.102788 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b6891278-24f3-4828-afaa-dba41052a916 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:26.112432 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b6891278-24f3-4828-afaa-dba41052a916 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1314 microversion: 2.1 time: 0.229241 Aug 18 14:26:26.113559 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 91/187] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:25 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:26.604227 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8e73262f-487e-4322-b6a7-11aeda9769f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:26.605205 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8e73262f-487e-4322-b6a7-11aeda9769f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:26.620377 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e73262f-487e-4322-b6a7-11aeda9769f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:26.623952 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e73262f-487e-4322-b6a7-11aeda9769f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:26.625410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e73262f-487e-4322-b6a7-11aeda9769f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:26.627007 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e73262f-487e-4322-b6a7-11aeda9769f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:26.627721 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e73262f-487e-4322-b6a7-11aeda9769f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:26.628525 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e73262f-487e-4322-b6a7-11aeda9769f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:27.136900 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a4732534-9bf5-46f3-bba2-dee3862da743 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:27.138811 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a4732534-9bf5-46f3-bba2-dee3862da743 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:27.148906 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4732534-9bf5-46f3-bba2-dee3862da743 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:27.149719 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4732534-9bf5-46f3-bba2-dee3862da743 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:27.150327 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4732534-9bf5-46f3-bba2-dee3862da743 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:27.151988 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4732534-9bf5-46f3-bba2-dee3862da743 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:27.152755 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4732534-9bf5-46f3-bba2-dee3862da743 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:27.153445 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4732534-9bf5-46f3-bba2-dee3862da743 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:27.221036 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8e73262f-487e-4322-b6a7-11aeda9769f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:27.236050 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8e73262f-487e-4322-b6a7-11aeda9769f3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.642898 Aug 18 14:26:27.248269 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 97/188] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:26 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:27.899593 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a4732534-9bf5-46f3-bba2-dee3862da743 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:27.912728 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a4732534-9bf5-46f3-bba2-dee3862da743 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1314 microversion: 2.1 time: 0.782190 Aug 18 14:26:27.913322 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 92/189] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:27 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1314 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:28.266144 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bd8a0f44-ad98-4a6c-a99e-dd4ed5378aec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:28.267577 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bd8a0f44-ad98-4a6c-a99e-dd4ed5378aec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:28.281230 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd8a0f44-ad98-4a6c-a99e-dd4ed5378aec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:28.284085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd8a0f44-ad98-4a6c-a99e-dd4ed5378aec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:28.286505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd8a0f44-ad98-4a6c-a99e-dd4ed5378aec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:28.287994 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd8a0f44-ad98-4a6c-a99e-dd4ed5378aec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:28.292566 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd8a0f44-ad98-4a6c-a99e-dd4ed5378aec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:28.294204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd8a0f44-ad98-4a6c-a99e-dd4ed5378aec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:28.402485 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d268b858-a614-4d80-9656-c28717c08f8e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Action: 'create', calling method: .version_select at 0x7fb62246b9d0>, body: {"keypair": {"name": "tempest-keypair-198222168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFU53B74U00HLgF6O65NSEDxXBYQxND9Z2foJCZIVuhXmetuuQ5YGH3Ho4R0//sEGZTXKNsHyfUf4SyUbUhJcLKnXSgsOduPcgKikG4eOJxbOWbWHHDYqM/ivfRWKD5pow=="}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:28.426109 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-d268b858-a614-4d80-9656-c28717c08f8e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Getting quotas for project e25458a67a8b4394b0ebca1482524608. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:26:28.433045 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-d268b858-a614-4d80-9656-c28717c08f8e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Getting quotas for user 8a3d1fa830b540adbe68ef7cf7f08004 and project e25458a67a8b4394b0ebca1482524608. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:26:28.481172 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d268b858-a614-4d80-9656-c28717c08f8e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.331547 Aug 18 14:26:28.483065 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 98/190] 10.222.0.39 () {62 vars in 1200 bytes} [Thu Aug 18 14:26:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 339 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 14:26:28.672950 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bd8a0f44-ad98-4a6c-a99e-dd4ed5378aec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:28.683361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bd8a0f44-ad98-4a6c-a99e-dd4ed5378aec tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1519 microversion: 2.1 time: 0.427497 Aug 18 14:26:28.684080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 93/191] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:28 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1519 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:28.934618 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b232a689-7659-45f8-9f5c-c37372af9944 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:28.935515 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b232a689-7659-45f8-9f5c-c37372af9944 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:28.947518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b232a689-7659-45f8-9f5c-c37372af9944 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:28.948368 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b232a689-7659-45f8-9f5c-c37372af9944 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:28.950946 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b232a689-7659-45f8-9f5c-c37372af9944 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:28.951903 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b232a689-7659-45f8-9f5c-c37372af9944 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:28.953586 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b232a689-7659-45f8-9f5c-c37372af9944 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:28.954538 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b232a689-7659-45f8-9f5c-c37372af9944 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:29.423263 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b232a689-7659-45f8-9f5c-c37372af9944 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:29.438020 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b232a689-7659-45f8-9f5c-c37372af9944 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1314 microversion: 2.1 time: 0.505459 Aug 18 14:26:29.454177 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 99/192] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:28 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:29.704853 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f8235ccd-216e-4105-aacf-27dc74ee10cc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:29.705472 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f8235ccd-216e-4105-aacf-27dc74ee10cc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:29.717567 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8235ccd-216e-4105-aacf-27dc74ee10cc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:29.718071 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8235ccd-216e-4105-aacf-27dc74ee10cc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:29.718516 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8235ccd-216e-4105-aacf-27dc74ee10cc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:29.719225 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8235ccd-216e-4105-aacf-27dc74ee10cc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:29.722155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8235ccd-216e-4105-aacf-27dc74ee10cc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:29.722602 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8235ccd-216e-4105-aacf-27dc74ee10cc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:30.036439 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f8235ccd-216e-4105-aacf-27dc74ee10cc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:30.050868 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f8235ccd-216e-4105-aacf-27dc74ee10cc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1499 microversion: 2.1 time: 0.349803 Aug 18 14:26:30.052366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 94/193] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:29 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1499 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:30.079753 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f01c167e-6791-41be-9996-431b2d8c75b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:30.080558 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f01c167e-6791-41be-9996-431b2d8c75b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:30.089265 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f01c167e-6791-41be-9996-431b2d8c75b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:30.090274 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f01c167e-6791-41be-9996-431b2d8c75b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:30.091058 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f01c167e-6791-41be-9996-431b2d8c75b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:30.092524 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f01c167e-6791-41be-9996-431b2d8c75b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:30.093176 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f01c167e-6791-41be-9996-431b2d8c75b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:30.094135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f01c167e-6791-41be-9996-431b2d8c75b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:30.456853 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:30.457770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:30.462714 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b3fc8cf3-6376-427a-89cb-dbb9fd3b2813 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:30.463495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b3fc8cf3-6376-427a-89cb-dbb9fd3b2813 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:30.478086 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3fc8cf3-6376-427a-89cb-dbb9fd3b2813 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:30.478717 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3fc8cf3-6376-427a-89cb-dbb9fd3b2813 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:30.479405 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3fc8cf3-6376-427a-89cb-dbb9fd3b2813 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:30.480801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3fc8cf3-6376-427a-89cb-dbb9fd3b2813 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:30.483080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3fc8cf3-6376-427a-89cb-dbb9fd3b2813 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:30.484898 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3fc8cf3-6376-427a-89cb-dbb9fd3b2813 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:30.556423 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f01c167e-6791-41be-9996-431b2d8c75b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:30.579512 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f01c167e-6791-41be-9996-431b2d8c75b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1514 microversion: 2.1 time: 0.506089 Aug 18 14:26:30.581430 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 100/194] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:30 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1514 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:30.802566 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b3fc8cf3-6376-427a-89cb-dbb9fd3b2813 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:30.806795 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:30.818852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b3fc8cf3-6376-427a-89cb-dbb9fd3b2813 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1314 microversion: 2.1 time: 0.362410 Aug 18 14:26:30.831883 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 95/195] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:30 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:31.245311 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-294813585", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "933fe250-3a07-4060-bbca-facb12e90528"}], "security_groups": [{"name": "tempest-securitygroup--958165393"}], "key_name": "tempest-keypair-198222168", "user_data": "}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:31.450467 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] validate_networks() for [('933fe250-3a07-4060-bbca-facb12e90528', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:26:31.844386 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b337d872-588e-48a4-8d93-a943ab280c46 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:31.846320 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b337d872-588e-48a4-8d93-a943ab280c46 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:31.854055 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b337d872-588e-48a4-8d93-a943ab280c46 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:31.854803 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b337d872-588e-48a4-8d93-a943ab280c46 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:31.855461 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b337d872-588e-48a4-8d93-a943ab280c46 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:31.856382 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b337d872-588e-48a4-8d93-a943ab280c46 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:31.857045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b337d872-588e-48a4-8d93-a943ab280c46 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:31.857656 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b337d872-588e-48a4-8d93-a943ab280c46 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:32.038867 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:26:32.040936 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:26:32.041601 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:26:32.042235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:26:32.042956 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:26:32.057519 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:32.058242 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:32.059919 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:32.061341 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:32.062052 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:32.062641 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:32.098094 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Getting quotas for project e25458a67a8b4394b0ebca1482524608. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:26:32.114575 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Getting quotas for user 8a3d1fa830b540adbe68ef7cf7f08004 and project e25458a67a8b4394b0ebca1482524608. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:26:32.141486 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:26:32.143934 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:26:32.164729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b337d872-588e-48a4-8d93-a943ab280c46 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:32.178690 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b337d872-588e-48a4-8d93-a943ab280c46 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1314 microversion: 2.1 time: 0.338300 Aug 18 14:26:32.180962 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 96/196] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:31 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:32.253691 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eeda3e09-bc13-4823-b7c1-39b4776c98c8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.013641 Aug 18 14:26:32.269747 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1db3e421-7bc1-413d-a693-ba310c9853e0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:32.270501 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1db3e421-7bc1-413d-a693-ba310c9853e0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:32.278759 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 101/197] 10.222.0.39 () {62 vars in 1188 bytes} [Thu Aug 18 14:26:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 14:26:32.366485 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1db3e421-7bc1-413d-a693-ba310c9853e0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:32.378373 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1db3e421-7bc1-413d-a693-ba310c9853e0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:32.382012 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1db3e421-7bc1-413d-a693-ba310c9853e0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:32.385829 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1db3e421-7bc1-413d-a693-ba310c9853e0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1280 microversion: 2.20 time: 0.119343 Aug 18 14:26:32.386655 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 97/198] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:32 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1280 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:26:32.424235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c7613500-6ed7-4865-85ba-ac939577ce5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:32.426904 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c7613500-6ed7-4865-85ba-ac939577ce5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:32.435465 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7613500-6ed7-4865-85ba-ac939577ce5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:32.436130 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7613500-6ed7-4865-85ba-ac939577ce5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:32.436833 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7613500-6ed7-4865-85ba-ac939577ce5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:32.437602 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7613500-6ed7-4865-85ba-ac939577ce5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:32.438175 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7613500-6ed7-4865-85ba-ac939577ce5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:32.438666 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7613500-6ed7-4865-85ba-ac939577ce5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:32.463800 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-c7613500-6ed7-4865-85ba-ac939577ce5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lazy-loading 'flavor' on Instance uuid 222bc1f0-96b3-4d29-960a-39437b4dc0a5 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:26:32.615696 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c7613500-6ed7-4865-85ba-ac939577ce5f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "POST /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5/action" status: 200 len: 32 microversion: 2.1 time: 0.195335 Aug 18 14:26:32.616915 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 102/199] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:26:32 2022] POST /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:26:32.626549 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8c002e98-ca06-4763-b528-2025ba246a35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:32.627164 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8c002e98-ca06-4763-b528-2025ba246a35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:32.641976 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c002e98-ca06-4763-b528-2025ba246a35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:32.642500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c002e98-ca06-4763-b528-2025ba246a35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:32.642939 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c002e98-ca06-4763-b528-2025ba246a35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:32.649571 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c002e98-ca06-4763-b528-2025ba246a35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:32.650465 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c002e98-ca06-4763-b528-2025ba246a35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:32.651127 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c002e98-ca06-4763-b528-2025ba246a35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:32.980307 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8c002e98-ca06-4763-b528-2025ba246a35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:32.993591 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8c002e98-ca06-4763-b528-2025ba246a35 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.370650 Aug 18 14:26:33.007518 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 98/200] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:32 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:33.204712 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0e640ec8-5d0b-4e1a-aa31-e2ea2af35f96 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:33.206043 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0e640ec8-5d0b-4e1a-aa31-e2ea2af35f96 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:33.220438 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e640ec8-5d0b-4e1a-aa31-e2ea2af35f96 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:33.222811 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e640ec8-5d0b-4e1a-aa31-e2ea2af35f96 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:33.223809 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e640ec8-5d0b-4e1a-aa31-e2ea2af35f96 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:33.224734 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e640ec8-5d0b-4e1a-aa31-e2ea2af35f96 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:33.225286 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e640ec8-5d0b-4e1a-aa31-e2ea2af35f96 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:33.225798 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e640ec8-5d0b-4e1a-aa31-e2ea2af35f96 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:33.413796 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7c0b582d-116c-4f30-811c-c4d3fdafabd8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:33.415016 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7c0b582d-116c-4f30-811c-c4d3fdafabd8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:33.422215 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c0b582d-116c-4f30-811c-c4d3fdafabd8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:33.422976 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c0b582d-116c-4f30-811c-c4d3fdafabd8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:33.423502 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c0b582d-116c-4f30-811c-c4d3fdafabd8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:33.424314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c0b582d-116c-4f30-811c-c4d3fdafabd8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:33.424920 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c0b582d-116c-4f30-811c-c4d3fdafabd8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:33.425341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c0b582d-116c-4f30-811c-c4d3fdafabd8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:33.441563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0e640ec8-5d0b-4e1a-aa31-e2ea2af35f96 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:33.451404 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0e640ec8-5d0b-4e1a-aa31-e2ea2af35f96 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1314 microversion: 2.1 time: 0.253189 Aug 18 14:26:33.452791 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 103/201] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:33 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:33.512335 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7c0b582d-116c-4f30-811c-c4d3fdafabd8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:33.521225 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7c0b582d-116c-4f30-811c-c4d3fdafabd8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:33.523221 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7c0b582d-116c-4f30-811c-c4d3fdafabd8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:33.524968 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7c0b582d-116c-4f30-811c-c4d3fdafabd8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1332 microversion: 2.20 time: 0.118684 Aug 18 14:26:33.525387 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 99/202] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:33 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1332 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:33.989799 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-8c827573-2700-40b8-853a-c5b252ea3d44 req-c6a409b5-72b9-4a36-957b-01345377d564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0c83fc-46e8-4ea0-ba6b-d28270f344f5", "name": "network-vif-plugged", "status": "completed", "tag": "c05a1310-a2bb-41fd-9f42-4609512b399d"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:33.996950 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:34.004113 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-8c827573-2700-40b8-853a-c5b252ea3d44 req-c6a409b5-72b9-4a36-957b-01345377d564 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:34.004901 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-8c827573-2700-40b8-853a-c5b252ea3d44 req-c6a409b5-72b9-4a36-957b-01345377d564 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:34.005563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-8c827573-2700-40b8-853a-c5b252ea3d44 req-c6a409b5-72b9-4a36-957b-01345377d564 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:34.019217 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1069b433-8cc4-49e0-b083-be790890c38a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:34.021840 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1069b433-8cc4-49e0-b083-be790890c38a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:34.032140 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-8c827573-2700-40b8-853a-c5b252ea3d44 req-c6a409b5-72b9-4a36-957b-01345377d564 service nova] Creating event network-vif-plugged:c05a1310-a2bb-41fd-9f42-4609512b399d for instance 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 on hv-cinder-85220 Aug 18 14:26:34.033000 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1069b433-8cc4-49e0-b083-be790890c38a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:34.033920 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1069b433-8cc4-49e0-b083-be790890c38a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:34.034521 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1069b433-8cc4-49e0-b083-be790890c38a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:34.035404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1069b433-8cc4-49e0-b083-be790890c38a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:34.036014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1069b433-8cc4-49e0-b083-be790890c38a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:34.036614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1069b433-8cc4-49e0-b083-be790890c38a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:34.049669 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-8c827573-2700-40b8-853a-c5b252ea3d44 req-c6a409b5-72b9-4a36-957b-01345377d564 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063259 Aug 18 14:26:34.054188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 104/203] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:26:34.224858 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1069b433-8cc4-49e0-b083-be790890c38a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:34.235355 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1069b433-8cc4-49e0-b083-be790890c38a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.220910 Aug 18 14:26:34.236542 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 100/204] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:34 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:34.474630 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-35ccfcea-4d65-46c3-8f54-a920b042620b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:34.475391 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-35ccfcea-4d65-46c3-8f54-a920b042620b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:34.482516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ccfcea-4d65-46c3-8f54-a920b042620b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:34.483357 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ccfcea-4d65-46c3-8f54-a920b042620b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:34.484161 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ccfcea-4d65-46c3-8f54-a920b042620b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:34.485669 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ccfcea-4d65-46c3-8f54-a920b042620b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:34.486585 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ccfcea-4d65-46c3-8f54-a920b042620b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:34.487159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ccfcea-4d65-46c3-8f54-a920b042620b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:34.551398 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1175586e-599f-41c7-b6da-a1e7e9dbe23f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:34.552054 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1175586e-599f-41c7-b6da-a1e7e9dbe23f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:34.558841 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1175586e-599f-41c7-b6da-a1e7e9dbe23f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:34.559332 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1175586e-599f-41c7-b6da-a1e7e9dbe23f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:34.559815 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1175586e-599f-41c7-b6da-a1e7e9dbe23f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:34.560550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1175586e-599f-41c7-b6da-a1e7e9dbe23f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:34.561005 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1175586e-599f-41c7-b6da-a1e7e9dbe23f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:34.561435 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1175586e-599f-41c7-b6da-a1e7e9dbe23f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:34.634147 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1175586e-599f-41c7-b6da-a1e7e9dbe23f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:34.644134 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1175586e-599f-41c7-b6da-a1e7e9dbe23f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:34.645644 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1175586e-599f-41c7-b6da-a1e7e9dbe23f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:34.647084 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1175586e-599f-41c7-b6da-a1e7e9dbe23f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1338 microversion: 2.20 time: 0.100554 Aug 18 14:26:34.647680 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 101/205] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:34 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:34.719327 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-35ccfcea-4d65-46c3-8f54-a920b042620b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:34.729351 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-35ccfcea-4d65-46c3-8f54-a920b042620b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1314 microversion: 2.1 time: 0.259555 Aug 18 14:26:34.729972 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 105/206] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:34 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:35.257713 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1e2255de-346c-44fc-9721-24bddf681ed8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:35.259006 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1e2255de-346c-44fc-9721-24bddf681ed8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:35.266023 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e2255de-346c-44fc-9721-24bddf681ed8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:35.266591 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e2255de-346c-44fc-9721-24bddf681ed8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:35.267091 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e2255de-346c-44fc-9721-24bddf681ed8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:35.267831 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e2255de-346c-44fc-9721-24bddf681ed8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:35.268710 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e2255de-346c-44fc-9721-24bddf681ed8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:35.269346 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e2255de-346c-44fc-9721-24bddf681ed8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:35.420190 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1e2255de-346c-44fc-9721-24bddf681ed8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:35.428228 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1e2255de-346c-44fc-9721-24bddf681ed8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.175438 Aug 18 14:26:35.428794 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 102/207] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:35 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:35.670359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-875f3e8e-eb0f-49be-8095-3ec825848a19 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:35.670964 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-875f3e8e-eb0f-49be-8095-3ec825848a19 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:35.677337 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-875f3e8e-eb0f-49be-8095-3ec825848a19 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:35.677808 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-875f3e8e-eb0f-49be-8095-3ec825848a19 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:35.678236 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-875f3e8e-eb0f-49be-8095-3ec825848a19 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:35.678906 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-875f3e8e-eb0f-49be-8095-3ec825848a19 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:35.679433 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-875f3e8e-eb0f-49be-8095-3ec825848a19 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:35.679980 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-875f3e8e-eb0f-49be-8095-3ec825848a19 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:35.754141 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-77f507d9-64af-4e7b-8795-0588facfe323 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:35.754844 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-77f507d9-64af-4e7b-8795-0588facfe323 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:35.762132 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77f507d9-64af-4e7b-8795-0588facfe323 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:35.762887 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77f507d9-64af-4e7b-8795-0588facfe323 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:35.763330 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77f507d9-64af-4e7b-8795-0588facfe323 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:35.764050 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77f507d9-64af-4e7b-8795-0588facfe323 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:35.764501 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77f507d9-64af-4e7b-8795-0588facfe323 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:35.764925 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77f507d9-64af-4e7b-8795-0588facfe323 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:35.809988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-875f3e8e-eb0f-49be-8095-3ec825848a19 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:35.818285 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-875f3e8e-eb0f-49be-8095-3ec825848a19 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:35.819872 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-875f3e8e-eb0f-49be-8095-3ec825848a19 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:35.822456 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-875f3e8e-eb0f-49be-8095-3ec825848a19 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.154943 Aug 18 14:26:35.822456 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 106/208] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:35 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:35.900892 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-77f507d9-64af-4e7b-8795-0588facfe323 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:35.909499 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-77f507d9-64af-4e7b-8795-0588facfe323 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1314 microversion: 2.1 time: 0.159037 Aug 18 14:26:35.910310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 103/209] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:35 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:36.450519 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c7f05140-c623-4508-afc5-047d0501e56f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:36.451886 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c7f05140-c623-4508-afc5-047d0501e56f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:36.459538 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7f05140-c623-4508-afc5-047d0501e56f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:36.460132 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7f05140-c623-4508-afc5-047d0501e56f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:36.460636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7f05140-c623-4508-afc5-047d0501e56f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:36.461995 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7f05140-c623-4508-afc5-047d0501e56f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:36.462526 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7f05140-c623-4508-afc5-047d0501e56f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:36.462959 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7f05140-c623-4508-afc5-047d0501e56f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:36.703354 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c7f05140-c623-4508-afc5-047d0501e56f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:36.713761 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c7f05140-c623-4508-afc5-047d0501e56f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.266896 Aug 18 14:26:36.715690 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 107/210] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:36 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:36.844973 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1bd5e8ae-dd72-49f4-b3dd-de6f3654347b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:36.845611 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1bd5e8ae-dd72-49f4-b3dd-de6f3654347b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:36.852141 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bd5e8ae-dd72-49f4-b3dd-de6f3654347b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:36.852833 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bd5e8ae-dd72-49f4-b3dd-de6f3654347b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:36.853463 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bd5e8ae-dd72-49f4-b3dd-de6f3654347b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:36.854157 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bd5e8ae-dd72-49f4-b3dd-de6f3654347b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:36.854609 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bd5e8ae-dd72-49f4-b3dd-de6f3654347b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:36.855037 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bd5e8ae-dd72-49f4-b3dd-de6f3654347b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:36.930344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e686e22c-1ff8-4647-b661-7972b8d684f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:36.931011 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e686e22c-1ff8-4647-b661-7972b8d684f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:36.937230 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e686e22c-1ff8-4647-b661-7972b8d684f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:36.937464 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e686e22c-1ff8-4647-b661-7972b8d684f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:36.937894 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e686e22c-1ff8-4647-b661-7972b8d684f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:36.938574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e686e22c-1ff8-4647-b661-7972b8d684f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:36.939189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e686e22c-1ff8-4647-b661-7972b8d684f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:36.939645 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e686e22c-1ff8-4647-b661-7972b8d684f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:37.001046 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1bd5e8ae-dd72-49f4-b3dd-de6f3654347b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:37.009625 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1bd5e8ae-dd72-49f4-b3dd-de6f3654347b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:37.011149 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1bd5e8ae-dd72-49f4-b3dd-de6f3654347b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:37.012292 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1bd5e8ae-dd72-49f4-b3dd-de6f3654347b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.171542 Aug 18 14:26:37.015426 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 104/211] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:36 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:37.146001 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e686e22c-1ff8-4647-b661-7972b8d684f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:37.155868 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e686e22c-1ff8-4647-b661-7972b8d684f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1314 microversion: 2.1 time: 0.229479 Aug 18 14:26:37.156552 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 108/212] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:36 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:37.203801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-e8a11e67-9cdb-4a56-9a13-d17b5247665b req-07b97e66-8498-4d47-a01c-5bc0ffbc21a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d09be0-5622-4167-859a-c81e38fc7218", "tag": "ce6e4f0c-73f1-4b80-9e83-e467ad9ba266"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:37.215130 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e8a11e67-9cdb-4a56-9a13-d17b5247665b req-07b97e66-8498-4d47-a01c-5bc0ffbc21a3 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:37.215637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e8a11e67-9cdb-4a56-9a13-d17b5247665b req-07b97e66-8498-4d47-a01c-5bc0ffbc21a3 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:37.216072 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e8a11e67-9cdb-4a56-9a13-d17b5247665b req-07b97e66-8498-4d47-a01c-5bc0ffbc21a3 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:37.227394 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-e8a11e67-9cdb-4a56-9a13-d17b5247665b req-07b97e66-8498-4d47-a01c-5bc0ffbc21a3 service nova] Creating event network-changed:ce6e4f0c-73f1-4b80-9e83-e467ad9ba266 for instance 95d09be0-5622-4167-859a-c81e38fc7218 on hv-cinder-85220 Aug 18 14:26:37.232560 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-e8a11e67-9cdb-4a56-9a13-d17b5247665b req-07b97e66-8498-4d47-a01c-5bc0ffbc21a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032333 Aug 18 14:26:37.233159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 105/213] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:26:37.747141 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fa6d59bb-ace1-416f-a5f3-e940ee8b0c71 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:37.754394 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fa6d59bb-ace1-416f-a5f3-e940ee8b0c71 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:37.764345 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa6d59bb-ace1-416f-a5f3-e940ee8b0c71 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:37.764837 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa6d59bb-ace1-416f-a5f3-e940ee8b0c71 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:37.765274 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa6d59bb-ace1-416f-a5f3-e940ee8b0c71 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:37.765974 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa6d59bb-ace1-416f-a5f3-e940ee8b0c71 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:37.766432 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa6d59bb-ace1-416f-a5f3-e940ee8b0c71 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:37.766863 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa6d59bb-ace1-416f-a5f3-e940ee8b0c71 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:37.906434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fa6d59bb-ace1-416f-a5f3-e940ee8b0c71 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:37.914775 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fa6d59bb-ace1-416f-a5f3-e940ee8b0c71 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.179919 Aug 18 14:26:37.915204 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 109/214] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:37 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:38.037448 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e41f871b-f174-42ec-9c76-4b234a4549a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:38.038491 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e41f871b-f174-42ec-9c76-4b234a4549a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:38.045164 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e41f871b-f174-42ec-9c76-4b234a4549a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:38.045876 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e41f871b-f174-42ec-9c76-4b234a4549a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:38.046300 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e41f871b-f174-42ec-9c76-4b234a4549a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:38.047000 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e41f871b-f174-42ec-9c76-4b234a4549a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:38.047491 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e41f871b-f174-42ec-9c76-4b234a4549a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:38.047915 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e41f871b-f174-42ec-9c76-4b234a4549a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:38.178464 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3daffade-39b5-4017-85a3-a28e18bbf651 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:38.179188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3daffade-39b5-4017-85a3-a28e18bbf651 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:38.186069 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3daffade-39b5-4017-85a3-a28e18bbf651 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:38.186627 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3daffade-39b5-4017-85a3-a28e18bbf651 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:38.187124 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3daffade-39b5-4017-85a3-a28e18bbf651 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:38.188000 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3daffade-39b5-4017-85a3-a28e18bbf651 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:38.188522 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3daffade-39b5-4017-85a3-a28e18bbf651 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:38.189012 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3daffade-39b5-4017-85a3-a28e18bbf651 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:38.191206 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e41f871b-f174-42ec-9c76-4b234a4549a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:38.202119 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e41f871b-f174-42ec-9c76-4b234a4549a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:38.203684 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e41f871b-f174-42ec-9c76-4b234a4549a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:38.204796 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e41f871b-f174-42ec-9c76-4b234a4549a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.172564 Aug 18 14:26:38.205347 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 106/215] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:38 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:38.325979 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3daffade-39b5-4017-85a3-a28e18bbf651 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:38.334597 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3daffade-39b5-4017-85a3-a28e18bbf651 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1314 microversion: 2.1 time: 0.160541 Aug 18 14:26:38.335205 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 110/216] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:38 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:38.935558 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8bf85900-ac42-4989-8a3b-6d2e2cd91f3c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:38.936213 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8bf85900-ac42-4989-8a3b-6d2e2cd91f3c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:38.938178 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:38.944139 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bf85900-ac42-4989-8a3b-6d2e2cd91f3c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:38.944824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bf85900-ac42-4989-8a3b-6d2e2cd91f3c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:38.945420 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bf85900-ac42-4989-8a3b-6d2e2cd91f3c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:38.946171 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bf85900-ac42-4989-8a3b-6d2e2cd91f3c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:38.946626 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bf85900-ac42-4989-8a3b-6d2e2cd91f3c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:38.947054 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bf85900-ac42-4989-8a3b-6d2e2cd91f3c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:39.078359 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8bf85900-ac42-4989-8a3b-6d2e2cd91f3c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:39.088007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8bf85900-ac42-4989-8a3b-6d2e2cd91f3c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.156305 Aug 18 14:26:39.088601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 107/217] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:38 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:39.229984 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bec17520-5087-4942-a76a-82abc0762a6d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:39.230594 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bec17520-5087-4942-a76a-82abc0762a6d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:39.236975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bec17520-5087-4942-a76a-82abc0762a6d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:39.237462 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bec17520-5087-4942-a76a-82abc0762a6d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:39.237895 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bec17520-5087-4942-a76a-82abc0762a6d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:39.238598 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bec17520-5087-4942-a76a-82abc0762a6d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:39.239033 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bec17520-5087-4942-a76a-82abc0762a6d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:39.239483 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bec17520-5087-4942-a76a-82abc0762a6d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:39.356141 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-27054bf0-f244-46a8-990b-c954346ecc2e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:39.356770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-27054bf0-f244-46a8-990b-c954346ecc2e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:39.363455 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27054bf0-f244-46a8-990b-c954346ecc2e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:39.363907 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27054bf0-f244-46a8-990b-c954346ecc2e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:39.364345 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27054bf0-f244-46a8-990b-c954346ecc2e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:39.365047 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27054bf0-f244-46a8-990b-c954346ecc2e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:39.365500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27054bf0-f244-46a8-990b-c954346ecc2e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:39.365927 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27054bf0-f244-46a8-990b-c954346ecc2e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:39.376355 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bec17520-5087-4942-a76a-82abc0762a6d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:39.378710 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:39.387593 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bec17520-5087-4942-a76a-82abc0762a6d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:39.389344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bec17520-5087-4942-a76a-82abc0762a6d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:39.390456 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bec17520-5087-4942-a76a-82abc0762a6d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.165107 Aug 18 14:26:39.391435 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 111/218] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:39 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:39.512378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-27054bf0-f244-46a8-990b-c954346ecc2e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:39.520050 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-27054bf0-f244-46a8-990b-c954346ecc2e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1314 microversion: 2.1 time: 0.167704 Aug 18 14:26:39.520624 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 108/219] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:39 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:40.109121 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3ebed229-5c51-452b-95e5-015ae8053856 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:40.109738 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3ebed229-5c51-452b-95e5-015ae8053856 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:40.117725 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ebed229-5c51-452b-95e5-015ae8053856 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:40.118214 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ebed229-5c51-452b-95e5-015ae8053856 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:40.118656 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ebed229-5c51-452b-95e5-015ae8053856 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:40.119340 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ebed229-5c51-452b-95e5-015ae8053856 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:40.119817 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ebed229-5c51-452b-95e5-015ae8053856 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:40.120239 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ebed229-5c51-452b-95e5-015ae8053856 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:40.257133 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3ebed229-5c51-452b-95e5-015ae8053856 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:40.264996 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3ebed229-5c51-452b-95e5-015ae8053856 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.159653 Aug 18 14:26:40.265821 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 112/220] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:40 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:40.414305 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-504c1f3b-44a4-4901-af9f-23d77aa5a079 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:40.415199 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-504c1f3b-44a4-4901-af9f-23d77aa5a079 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:40.421262 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-504c1f3b-44a4-4901-af9f-23d77aa5a079 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:40.421741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-504c1f3b-44a4-4901-af9f-23d77aa5a079 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:40.422166 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-504c1f3b-44a4-4901-af9f-23d77aa5a079 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:40.422838 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-504c1f3b-44a4-4901-af9f-23d77aa5a079 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:40.423282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-504c1f3b-44a4-4901-af9f-23d77aa5a079 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:40.423725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-504c1f3b-44a4-4901-af9f-23d77aa5a079 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:40.542022 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cda10bd5-c8fd-43bf-b43e-2644c17e7eb2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:40.543048 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cda10bd5-c8fd-43bf-b43e-2644c17e7eb2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:40.549150 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cda10bd5-c8fd-43bf-b43e-2644c17e7eb2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:40.549629 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cda10bd5-c8fd-43bf-b43e-2644c17e7eb2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:40.550234 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cda10bd5-c8fd-43bf-b43e-2644c17e7eb2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:40.550938 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cda10bd5-c8fd-43bf-b43e-2644c17e7eb2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:40.551421 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cda10bd5-c8fd-43bf-b43e-2644c17e7eb2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:40.551858 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cda10bd5-c8fd-43bf-b43e-2644c17e7eb2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:40.559456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-504c1f3b-44a4-4901-af9f-23d77aa5a079 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:40.567875 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-504c1f3b-44a4-4901-af9f-23d77aa5a079 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:40.569453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-504c1f3b-44a4-4901-af9f-23d77aa5a079 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:40.570727 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-504c1f3b-44a4-4901-af9f-23d77aa5a079 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.160954 Aug 18 14:26:40.571710 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 109/221] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:40 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:40.995668 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cda10bd5-c8fd-43bf-b43e-2644c17e7eb2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:41.003660 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cda10bd5-c8fd-43bf-b43e-2644c17e7eb2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1314 microversion: 2.1 time: 0.466188 Aug 18 14:26:41.004223 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 113/222] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:40 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:41.285777 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-29ab262d-710a-48ad-801e-6a13496cba29 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:41.286391 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-29ab262d-710a-48ad-801e-6a13496cba29 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:41.292922 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29ab262d-710a-48ad-801e-6a13496cba29 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:41.293402 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29ab262d-710a-48ad-801e-6a13496cba29 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:41.293829 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29ab262d-710a-48ad-801e-6a13496cba29 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:41.294504 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29ab262d-710a-48ad-801e-6a13496cba29 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:41.294950 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29ab262d-710a-48ad-801e-6a13496cba29 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:41.295380 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29ab262d-710a-48ad-801e-6a13496cba29 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:41.457364 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-29ab262d-710a-48ad-801e-6a13496cba29 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:41.467225 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-29ab262d-710a-48ad-801e-6a13496cba29 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.185171 Aug 18 14:26:41.468335 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 110/223] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:41 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:41.594178 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-03c50de7-caa8-4208-a8e3-73cb44a37d60 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:41.595046 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-03c50de7-caa8-4208-a8e3-73cb44a37d60 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:41.602028 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03c50de7-caa8-4208-a8e3-73cb44a37d60 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:41.602704 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03c50de7-caa8-4208-a8e3-73cb44a37d60 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:41.603184 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03c50de7-caa8-4208-a8e3-73cb44a37d60 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:41.603871 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03c50de7-caa8-4208-a8e3-73cb44a37d60 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:41.604322 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03c50de7-caa8-4208-a8e3-73cb44a37d60 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:41.604749 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03c50de7-caa8-4208-a8e3-73cb44a37d60 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:41.964972 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-03c50de7-caa8-4208-a8e3-73cb44a37d60 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:41.976509 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-03c50de7-caa8-4208-a8e3-73cb44a37d60 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:41.978523 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-03c50de7-caa8-4208-a8e3-73cb44a37d60 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:41.979676 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-03c50de7-caa8-4208-a8e3-73cb44a37d60 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.389349 Aug 18 14:26:41.980702 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 114/224] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:41 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:42.027012 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2e0ee745-a83d-448a-a6b8-a16d2b7f1e72 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:42.028295 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2e0ee745-a83d-448a-a6b8-a16d2b7f1e72 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:42.034372 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e0ee745-a83d-448a-a6b8-a16d2b7f1e72 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:42.035053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e0ee745-a83d-448a-a6b8-a16d2b7f1e72 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:42.035527 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e0ee745-a83d-448a-a6b8-a16d2b7f1e72 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:42.036214 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e0ee745-a83d-448a-a6b8-a16d2b7f1e72 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:42.036835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e0ee745-a83d-448a-a6b8-a16d2b7f1e72 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:42.037263 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e0ee745-a83d-448a-a6b8-a16d2b7f1e72 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:42.181270 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2e0ee745-a83d-448a-a6b8-a16d2b7f1e72 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:42.189223 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2e0ee745-a83d-448a-a6b8-a16d2b7f1e72 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1498 microversion: 2.1 time: 0.167449 Aug 18 14:26:42.203396 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 111/225] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:42 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:42.489022 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a19bde81-8ecb-4e55-89fe-53b30480c5f0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:42.489711 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a19bde81-8ecb-4e55-89fe-53b30480c5f0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:42.491557 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:42.492452 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=12 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:42.499289 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a19bde81-8ecb-4e55-89fe-53b30480c5f0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:42.499815 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a19bde81-8ecb-4e55-89fe-53b30480c5f0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:42.500252 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a19bde81-8ecb-4e55-89fe-53b30480c5f0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:42.500956 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a19bde81-8ecb-4e55-89fe-53b30480c5f0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:42.501412 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a19bde81-8ecb-4e55-89fe-53b30480c5f0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:42.501839 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a19bde81-8ecb-4e55-89fe-53b30480c5f0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:42.671284 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a19bde81-8ecb-4e55-89fe-53b30480c5f0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:42.678907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a19bde81-8ecb-4e55-89fe-53b30480c5f0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.193936 Aug 18 14:26:42.679477 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 115/226] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:42 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:42.873525 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cf036671-8e84-439c-babc-b57a92b6564d tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:42.874038 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cf036671-8e84-439c-babc-b57a92b6564d tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:42.876078 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:42.881869 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf036671-8e84-439c-babc-b57a92b6564d tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:42.882545 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf036671-8e84-439c-babc-b57a92b6564d tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:42.883858 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf036671-8e84-439c-babc-b57a92b6564d tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:42.884662 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf036671-8e84-439c-babc-b57a92b6564d tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:42.885487 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf036671-8e84-439c-babc-b57a92b6564d tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:42.886174 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf036671-8e84-439c-babc-b57a92b6564d tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:42.913071 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cf036671-8e84-439c-babc-b57a92b6564d tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:26:42.976537 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:43.008333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-af05046d-dc8b-43a9-be7c-5e9eeb740ac7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:43.009586 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-af05046d-dc8b-43a9-be7c-5e9eeb740ac7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:43.017669 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af05046d-dc8b-43a9-be7c-5e9eeb740ac7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:43.017870 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cf036671-8e84-439c-babc-b57a92b6564d tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 204 len: 0 microversion: 2.1 time: 0.148369 Aug 18 14:26:43.018184 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af05046d-dc8b-43a9-be7c-5e9eeb740ac7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:43.021442 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 112/227] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:26:42 2022] DELETE /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:26:43.022118 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af05046d-dc8b-43a9-be7c-5e9eeb740ac7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:43.022118 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af05046d-dc8b-43a9-be7c-5e9eeb740ac7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:43.022118 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af05046d-dc8b-43a9-be7c-5e9eeb740ac7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:43.022118 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af05046d-dc8b-43a9-be7c-5e9eeb740ac7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:43.032358 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d94a0928-2ef4-4ff8-8080-23d8d35850ba tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:43.032768 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d94a0928-2ef4-4ff8-8080-23d8d35850ba tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:43.041399 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d94a0928-2ef4-4ff8-8080-23d8d35850ba tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:43.041399 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d94a0928-2ef4-4ff8-8080-23d8d35850ba tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:43.041946 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d94a0928-2ef4-4ff8-8080-23d8d35850ba tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:43.043162 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d94a0928-2ef4-4ff8-8080-23d8d35850ba tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:43.043681 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d94a0928-2ef4-4ff8-8080-23d8d35850ba tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:43.044189 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d94a0928-2ef4-4ff8-8080-23d8d35850ba tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:43.177768 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-af05046d-dc8b-43a9-be7c-5e9eeb740ac7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:43.189132 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-af05046d-dc8b-43a9-be7c-5e9eeb740ac7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:43.193587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-af05046d-dc8b-43a9-be7c-5e9eeb740ac7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:43.195535 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-af05046d-dc8b-43a9-be7c-5e9eeb740ac7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.191267 Aug 18 14:26:43.196635 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 116/228] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:43 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:43.203810 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d94a0928-2ef4-4ff8-8080-23d8d35850ba tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:43.212389 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d94a0928-2ef4-4ff8-8080-23d8d35850ba tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1504 microversion: 2.1 time: 0.185033 Aug 18 14:26:43.212949 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 113/229] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:43 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:43.699990 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1dc03768-fd2e-4864-860e-6a9df10364e4 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:43.700937 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1dc03768-fd2e-4864-860e-6a9df10364e4 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:43.712125 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dc03768-fd2e-4864-860e-6a9df10364e4 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:43.712849 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dc03768-fd2e-4864-860e-6a9df10364e4 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:43.713562 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dc03768-fd2e-4864-860e-6a9df10364e4 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:43.714690 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dc03768-fd2e-4864-860e-6a9df10364e4 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:43.715455 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dc03768-fd2e-4864-860e-6a9df10364e4 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:43.716557 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dc03768-fd2e-4864-860e-6a9df10364e4 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:43.866087 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1dc03768-fd2e-4864-860e-6a9df10364e4 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:43.873873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1dc03768-fd2e-4864-860e-6a9df10364e4 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.178506 Aug 18 14:26:43.874474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 117/230] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:43 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:44.218014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-81b0e6ff-544c-4496-93b4-ff985de96c5e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:44.218629 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-81b0e6ff-544c-4496-93b4-ff985de96c5e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:44.224985 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81b0e6ff-544c-4496-93b4-ff985de96c5e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:44.225472 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81b0e6ff-544c-4496-93b4-ff985de96c5e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:44.226211 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81b0e6ff-544c-4496-93b4-ff985de96c5e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:44.227238 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81b0e6ff-544c-4496-93b4-ff985de96c5e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:44.227836 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81b0e6ff-544c-4496-93b4-ff985de96c5e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:44.228422 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81b0e6ff-544c-4496-93b4-ff985de96c5e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:44.236197 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e07e453d-994d-4f33-9e09-e2cb0f642a51 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:44.236895 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e07e453d-994d-4f33-9e09-e2cb0f642a51 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:44.244405 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e07e453d-994d-4f33-9e09-e2cb0f642a51 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:44.245171 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e07e453d-994d-4f33-9e09-e2cb0f642a51 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:44.245865 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e07e453d-994d-4f33-9e09-e2cb0f642a51 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:44.246816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e07e453d-994d-4f33-9e09-e2cb0f642a51 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:44.247576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e07e453d-994d-4f33-9e09-e2cb0f642a51 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:44.248170 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e07e453d-994d-4f33-9e09-e2cb0f642a51 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:44.378819 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81b0e6ff-544c-4496-93b4-ff985de96c5e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:44.390609 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81b0e6ff-544c-4496-93b4-ff985de96c5e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:44.394010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e07e453d-994d-4f33-9e09-e2cb0f642a51 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:44.399038 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81b0e6ff-544c-4496-93b4-ff985de96c5e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:44.400411 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-81b0e6ff-544c-4496-93b4-ff985de96c5e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.186280 Aug 18 14:26:44.401313 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 114/231] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:44 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:44.416615 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e07e453d-994d-4f33-9e09-e2cb0f642a51 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1504 microversion: 2.1 time: 0.184114 Aug 18 14:26:44.417196 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 118/232] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:44 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1504 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:44.900128 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8f28dd3c-f7b6-4346-99e7-f8073e0340ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:44.901598 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8f28dd3c-f7b6-4346-99e7-f8073e0340ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:44.909629 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f28dd3c-f7b6-4346-99e7-f8073e0340ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:44.910123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f28dd3c-f7b6-4346-99e7-f8073e0340ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:44.911433 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f28dd3c-f7b6-4346-99e7-f8073e0340ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:44.912156 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f28dd3c-f7b6-4346-99e7-f8073e0340ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:44.912610 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f28dd3c-f7b6-4346-99e7-f8073e0340ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:44.913038 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f28dd3c-f7b6-4346-99e7-f8073e0340ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:45.171979 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8f28dd3c-f7b6-4346-99e7-f8073e0340ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:45.184593 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8f28dd3c-f7b6-4346-99e7-f8073e0340ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.289181 Aug 18 14:26:45.185230 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 115/233] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:44 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:45.416709 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-3afd544b-d9b1-48ae-896f-445413a1dbcc req-19182418-1267-43ba-8405-0524686a163c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0c83fc-46e8-4ea0-ba6b-d28270f344f5", "name": "network-vif-deleted", "tag": "c05a1310-a2bb-41fd-9f42-4609512b399d"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:45.425756 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3c1dc72b-1107-4d3d-a3be-4e45d05bd16b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:45.426371 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3c1dc72b-1107-4d3d-a3be-4e45d05bd16b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:45.429115 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-3afd544b-d9b1-48ae-896f-445413a1dbcc req-19182418-1267-43ba-8405-0524686a163c service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:45.430510 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-3afd544b-d9b1-48ae-896f-445413a1dbcc req-19182418-1267-43ba-8405-0524686a163c service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:45.430961 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-3afd544b-d9b1-48ae-896f-445413a1dbcc req-19182418-1267-43ba-8405-0524686a163c service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:45.435741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c1dc72b-1107-4d3d-a3be-4e45d05bd16b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:45.436450 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c1dc72b-1107-4d3d-a3be-4e45d05bd16b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:45.436881 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c1dc72b-1107-4d3d-a3be-4e45d05bd16b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:45.437606 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c1dc72b-1107-4d3d-a3be-4e45d05bd16b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:45.438055 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c1dc72b-1107-4d3d-a3be-4e45d05bd16b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:45.438476 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c1dc72b-1107-4d3d-a3be-4e45d05bd16b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:45.448758 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-3afd544b-d9b1-48ae-896f-445413a1dbcc req-19182418-1267-43ba-8405-0524686a163c service nova] Creating event network-vif-deleted:c05a1310-a2bb-41fd-9f42-4609512b399d for instance 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 on hv-cinder-85220 Aug 18 14:26:45.454656 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-3afd544b-d9b1-48ae-896f-445413a1dbcc req-19182418-1267-43ba-8405-0524686a163c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042701 Aug 18 14:26:45.455360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 119/234] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:26:45.462919 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-89043dc5-109a-4cd1-b2c2-a55471fe7b5e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:45.463794 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-89043dc5-109a-4cd1-b2c2-a55471fe7b5e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:45.472768 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89043dc5-109a-4cd1-b2c2-a55471fe7b5e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:45.474114 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89043dc5-109a-4cd1-b2c2-a55471fe7b5e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:45.474646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89043dc5-109a-4cd1-b2c2-a55471fe7b5e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:45.475557 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89043dc5-109a-4cd1-b2c2-a55471fe7b5e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:45.476686 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89043dc5-109a-4cd1-b2c2-a55471fe7b5e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:45.477469 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89043dc5-109a-4cd1-b2c2-a55471fe7b5e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:45.552318 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-89043dc5-109a-4cd1-b2c2-a55471fe7b5e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:45.561979 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-89043dc5-109a-4cd1-b2c2-a55471fe7b5e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1299 microversion: 2.1 time: 0.104571 Aug 18 14:26:45.562794 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 120/235] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:45 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:45.598897 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3c1dc72b-1107-4d3d-a3be-4e45d05bd16b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:45.608071 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3c1dc72b-1107-4d3d-a3be-4e45d05bd16b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:45.609573 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3c1dc72b-1107-4d3d-a3be-4e45d05bd16b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:45.610683 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3c1dc72b-1107-4d3d-a3be-4e45d05bd16b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.188882 Aug 18 14:26:45.611241 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 116/236] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:45 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:46.205822 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ed82e481-6c8e-467a-9416-d091db8a2d98 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:46.206368 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ed82e481-6c8e-467a-9416-d091db8a2d98 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:46.213241 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed82e481-6c8e-467a-9416-d091db8a2d98 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:46.213721 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed82e481-6c8e-467a-9416-d091db8a2d98 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:46.214165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed82e481-6c8e-467a-9416-d091db8a2d98 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:46.214853 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed82e481-6c8e-467a-9416-d091db8a2d98 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:46.215310 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed82e481-6c8e-467a-9416-d091db8a2d98 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:46.215771 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed82e481-6c8e-467a-9416-d091db8a2d98 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:46.353690 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ed82e481-6c8e-467a-9416-d091db8a2d98 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:46.362102 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ed82e481-6c8e-467a-9416-d091db8a2d98 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.160155 Aug 18 14:26:46.362796 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 121/237] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:46 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:46.586167 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:46.587270 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:46.595470 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:46.596278 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:46.598357 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:46.599515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:46.599933 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:46.600362 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:46.634839 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cfb8010c-f8cf-450e-a9da-0cff5a2a42bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:46.635486 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cfb8010c-f8cf-450e-a9da-0cff5a2a42bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:46.644902 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfb8010c-f8cf-450e-a9da-0cff5a2a42bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:46.645390 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfb8010c-f8cf-450e-a9da-0cff5a2a42bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:46.645822 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfb8010c-f8cf-450e-a9da-0cff5a2a42bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:46.646521 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfb8010c-f8cf-450e-a9da-0cff5a2a42bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:46.647057 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfb8010c-f8cf-450e-a9da-0cff5a2a42bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:46.647395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfb8010c-f8cf-450e-a9da-0cff5a2a42bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:46.656370 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:46.656860 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:46.657897 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:46.658514 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lazy-loading 'fault' on Instance uuid 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:26:46.714054 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:46.722112 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5e9f91b8-976d-4860-909a-f5d1619d4e35 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1304 microversion: 2.1 time: 0.142264 Aug 18 14:26:46.722690 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 117/238] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:46 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:46.784082 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cfb8010c-f8cf-450e-a9da-0cff5a2a42bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:46.798365 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cfb8010c-f8cf-450e-a9da-0cff5a2a42bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:46.799881 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cfb8010c-f8cf-450e-a9da-0cff5a2a42bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:46.801198 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cfb8010c-f8cf-450e-a9da-0cff5a2a42bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.171076 Aug 18 14:26:46.801887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 122/239] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:46 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:26:47.383864 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0b660120-d5c8-4e3c-bb36-c64ba74fba03 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:47.384471 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0b660120-d5c8-4e3c-bb36-c64ba74fba03 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:47.390429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b660120-d5c8-4e3c-bb36-c64ba74fba03 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:47.390904 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b660120-d5c8-4e3c-bb36-c64ba74fba03 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:47.391331 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b660120-d5c8-4e3c-bb36-c64ba74fba03 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:47.392028 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b660120-d5c8-4e3c-bb36-c64ba74fba03 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:47.392472 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b660120-d5c8-4e3c-bb36-c64ba74fba03 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:47.392939 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b660120-d5c8-4e3c-bb36-c64ba74fba03 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:47.524556 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0b660120-d5c8-4e3c-bb36-c64ba74fba03 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:47.532164 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0b660120-d5c8-4e3c-bb36-c64ba74fba03 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.152957 Aug 18 14:26:47.532728 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 118/240] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:47 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:47.744353 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:47.744972 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:47.751465 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:47.751950 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:47.752394 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:47.753083 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:47.753540 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:47.753969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:47.785976 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:47.786721 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:47.787161 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:47.787650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lazy-loading 'fault' on Instance uuid 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:26:47.827307 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cb4bb2f7-218e-45df-8bbe-886d9da3778b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:47.827975 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cb4bb2f7-218e-45df-8bbe-886d9da3778b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:47.832812 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:47.834264 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb4bb2f7-218e-45df-8bbe-886d9da3778b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:47.834755 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb4bb2f7-218e-45df-8bbe-886d9da3778b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:47.835198 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb4bb2f7-218e-45df-8bbe-886d9da3778b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:47.836000 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb4bb2f7-218e-45df-8bbe-886d9da3778b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:47.836451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb4bb2f7-218e-45df-8bbe-886d9da3778b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:47.836885 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb4bb2f7-218e-45df-8bbe-886d9da3778b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:47.840880 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-055b469c-1905-48c6-baac-664452c52f7c tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 200 len: 1304 microversion: 2.1 time: 0.101096 Aug 18 14:26:47.841453 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 123/241] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:47 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:47.979005 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cb4bb2f7-218e-45df-8bbe-886d9da3778b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:47.984423 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cb4bb2f7-218e-45df-8bbe-886d9da3778b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:47.985905 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cb4bb2f7-218e-45df-8bbe-886d9da3778b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:47.986997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cb4bb2f7-218e-45df-8bbe-886d9da3778b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.163671 Aug 18 14:26:47.987586 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 119/242] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:47 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:48.554791 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bd122152-3496-4609-8462-6296b7347095 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:48.555459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bd122152-3496-4609-8462-6296b7347095 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:48.561458 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd122152-3496-4609-8462-6296b7347095 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:48.561942 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd122152-3496-4609-8462-6296b7347095 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:48.562381 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd122152-3496-4609-8462-6296b7347095 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:48.563077 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd122152-3496-4609-8462-6296b7347095 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:48.563566 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd122152-3496-4609-8462-6296b7347095 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:48.563997 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd122152-3496-4609-8462-6296b7347095 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:48.705364 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bd122152-3496-4609-8462-6296b7347095 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:48.713871 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bd122152-3496-4609-8462-6296b7347095 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.164591 Aug 18 14:26:48.714454 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 124/243] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:48 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:48.862359 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e96e02bf-b153-434e-bd4d-69cbe9270025 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:48.863168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e96e02bf-b153-434e-bd4d-69cbe9270025 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:48.870152 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e96e02bf-b153-434e-bd4d-69cbe9270025 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:48.870629 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e96e02bf-b153-434e-bd4d-69cbe9270025 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:48.871060 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e96e02bf-b153-434e-bd4d-69cbe9270025 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:48.871767 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e96e02bf-b153-434e-bd4d-69cbe9270025 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:48.872364 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e96e02bf-b153-434e-bd4d-69cbe9270025 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:48.872908 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e96e02bf-b153-434e-bd4d-69cbe9270025 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:48.887924 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-e96e02bf-b153-434e-bd4d-69cbe9270025 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] HTTP exception thrown: Instance 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 could not be found. Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e96e02bf-b153-434e-bd4d-69cbe9270025 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Request method failure captured: Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 HTTP/1.1 Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kwJNr70HoNs6WoU5pg3U3w6l-fwgwap_OOxfurobed_Z-c82hzV2MVXlHb67BRqhmd27pCkNTX0umxWitBHnXlKj-3brtR3kzYY5ZdxyFJhwTcynMXUSFUYCC7dBOcIFDRJ_w7zTy2qSHI8Ykyq-ffS5E_SyRHeZkYJANmf0DjGdto Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: a8c8f3970f01483b84fce0859a219c84 Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesActionsTest-316541229 Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:26:48.890366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:26:48.891654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a8c8f3970f01483b84fce0859a219c84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a8c8f3970f01483b84fce0859a219c84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a8c8f3970f01483b84fce0859a219c84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a8c8f3970f01483b84fce0859a219c84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:26:48.891654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesActionsTest-316541229 Aug 18 14:26:48.891654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: a8c8f3970f01483b84fce0859a219c84 Aug 18 14:26:48.891654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesActionsTest-316541229 Aug 18 14:26:48.891654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesActionsTest-316541229-project Aug 18 14:26:48.891654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:26:48.891654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:26:48.891654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 278dd42fb0264c44b7926fb9d1ff46c0 Aug 18 14:26:48.891654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesActionsTest-316541229-project Aug 18 14:26:48.891654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:26:48.891654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 could not be found. Aug 18 14:26:48.891654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '4e0c83fc-46e8-4ea0-ba6b-d28270f344f5'} Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 could not be found. Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:26:48.892429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 could not be found. Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 could not be found. Aug 18 14:26:48.894715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:48.896852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e96e02bf-b153-434e-bd4d-69cbe9270025 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Returning 404 to user: Instance 4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:26:48.896852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e96e02bf-b153-434e-bd4d-69cbe9270025 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5" status: 404 len: 111 microversion: 2.1 time: 0.034225 Aug 18 14:26:48.900187 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 120/244] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:48 2022] GET /compute/v2.1/servers/4e0c83fc-46e8-4ea0-ba6b-d28270f344f5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:26:49.009907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e55e8c55-2fa9-44a1-8807-8a7fd73ee957 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:49.010518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e55e8c55-2fa9-44a1-8807-8a7fd73ee957 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:49.015146 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-484492555", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "networks": [{"uuid": "be329242-7c49-4d4f-bd52-60f3795ae90b"}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:49.028909 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e55e8c55-2fa9-44a1-8807-8a7fd73ee957 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:49.029310 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e55e8c55-2fa9-44a1-8807-8a7fd73ee957 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:49.029829 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e55e8c55-2fa9-44a1-8807-8a7fd73ee957 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:49.030806 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e55e8c55-2fa9-44a1-8807-8a7fd73ee957 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:49.031304 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e55e8c55-2fa9-44a1-8807-8a7fd73ee957 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:49.032082 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e55e8c55-2fa9-44a1-8807-8a7fd73ee957 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:49.096560 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] validate_networks() for [('be329242-7c49-4d4f-bd52-60f3795ae90b', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:26:49.190953 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e55e8c55-2fa9-44a1-8807-8a7fd73ee957 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:49.200637 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e55e8c55-2fa9-44a1-8807-8a7fd73ee957 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:49.206584 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e55e8c55-2fa9-44a1-8807-8a7fd73ee957 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:49.209449 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e55e8c55-2fa9-44a1-8807-8a7fd73ee957 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.204071 Aug 18 14:26:49.210593 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 125/245] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:49 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:49.511565 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:26:49.511565 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:26:49.511565 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:26:49.512245 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:26:49.512763 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:26:49.522144 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:49.522606 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:49.523506 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:49.524546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:49.524999 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:49.525604 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:49.543462 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Getting quotas for project a8c8f3970f01483b84fce0859a219c84. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:26:49.547544 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Getting quotas for user 278dd42fb0264c44b7926fb9d1ff46c0 and project a8c8f3970f01483b84fce0859a219c84. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:26:49.560072 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:26:49.562628 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:26:49.612728 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f447cd56-b457-4464-96eb-5b27556519e3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601201 Aug 18 14:26:49.619736 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 121/246] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:26:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:26:49.625078 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9234f50e-420a-4d5f-8c67-6f64332040f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:49.625694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9234f50e-420a-4d5f-8c67-6f64332040f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:49.683041 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9234f50e-420a-4d5f-8c67-6f64332040f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:49.690010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9234f50e-420a-4d5f-8c67-6f64332040f1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1213 microversion: 2.1 time: 0.068713 Aug 18 14:26:49.690584 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 126/247] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:49 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:49.739526 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0eaff094-8913-4be4-8489-9721a627889a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:49.739526 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0eaff094-8913-4be4-8489-9721a627889a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:49.745532 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0eaff094-8913-4be4-8489-9721a627889a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:49.746023 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0eaff094-8913-4be4-8489-9721a627889a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:49.746462 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0eaff094-8913-4be4-8489-9721a627889a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:49.747195 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0eaff094-8913-4be4-8489-9721a627889a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:49.747684 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0eaff094-8913-4be4-8489-9721a627889a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:49.748131 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0eaff094-8913-4be4-8489-9721a627889a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:49.893751 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0eaff094-8913-4be4-8489-9721a627889a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:49.902926 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0eaff094-8913-4be4-8489-9721a627889a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.170379 Aug 18 14:26:49.903553 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 122/248] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:49 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:50.232742 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d9693e60-3086-4edb-aa07-17c4fbe56282 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:50.233370 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d9693e60-3086-4edb-aa07-17c4fbe56282 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:50.248761 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9693e60-3086-4edb-aa07-17c4fbe56282 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:50.249411 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9693e60-3086-4edb-aa07-17c4fbe56282 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:50.249959 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9693e60-3086-4edb-aa07-17c4fbe56282 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:50.250681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9693e60-3086-4edb-aa07-17c4fbe56282 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:50.251140 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9693e60-3086-4edb-aa07-17c4fbe56282 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:50.251604 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9693e60-3086-4edb-aa07-17c4fbe56282 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:50.255106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-2b983100-3628-4577-9d3f-f9077f3de8d3 req-a4f51caf-9135-40dd-a151-63c99f429499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d09be0-5622-4167-859a-c81e38fc7218", "name": "network-vif-plugged", "status": "completed", "tag": "ce6e4f0c-73f1-4b80-9e83-e467ad9ba266"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:50.287707 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-2b983100-3628-4577-9d3f-f9077f3de8d3 req-a4f51caf-9135-40dd-a151-63c99f429499 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:50.288587 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-2b983100-3628-4577-9d3f-f9077f3de8d3 req-a4f51caf-9135-40dd-a151-63c99f429499 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:50.291483 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-2b983100-3628-4577-9d3f-f9077f3de8d3 req-a4f51caf-9135-40dd-a151-63c99f429499 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:50.314168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-2b983100-3628-4577-9d3f-f9077f3de8d3 req-a4f51caf-9135-40dd-a151-63c99f429499 service nova] Creating event network-vif-plugged:ce6e4f0c-73f1-4b80-9e83-e467ad9ba266 for instance 95d09be0-5622-4167-859a-c81e38fc7218 on hv-cinder-85220 Aug 18 14:26:50.322050 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-2b983100-3628-4577-9d3f-f9077f3de8d3 req-a4f51caf-9135-40dd-a151-63c99f429499 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070671 Aug 18 14:26:50.324015 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 123/249] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:26:50.447233 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d9693e60-3086-4edb-aa07-17c4fbe56282 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:50.456909 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d9693e60-3086-4edb-aa07-17c4fbe56282 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:50.461592 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d9693e60-3086-4edb-aa07-17c4fbe56282 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:50.462841 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d9693e60-3086-4edb-aa07-17c4fbe56282 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.234349 Aug 18 14:26:50.463667 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 127/250] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:50 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:50.711283 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-82b46f7d-6d80-494d-9407-94676e893a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:50.712136 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-82b46f7d-6d80-494d-9407-94676e893a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:50.718938 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82b46f7d-6d80-494d-9407-94676e893a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:50.719792 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82b46f7d-6d80-494d-9407-94676e893a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:50.720515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82b46f7d-6d80-494d-9407-94676e893a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:50.721578 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82b46f7d-6d80-494d-9407-94676e893a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:50.722135 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82b46f7d-6d80-494d-9407-94676e893a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:50.722649 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82b46f7d-6d80-494d-9407-94676e893a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:50.808038 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-82b46f7d-6d80-494d-9407-94676e893a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:50.827513 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-82b46f7d-6d80-494d-9407-94676e893a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1273 microversion: 2.1 time: 0.119730 Aug 18 14:26:50.828579 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 124/251] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:50 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:50.924682 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ba00e79a-d1cd-4b27-b81b-12d4578f6991 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:50.925720 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ba00e79a-d1cd-4b27-b81b-12d4578f6991 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:50.935294 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba00e79a-d1cd-4b27-b81b-12d4578f6991 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:50.936016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba00e79a-d1cd-4b27-b81b-12d4578f6991 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:50.936448 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba00e79a-d1cd-4b27-b81b-12d4578f6991 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:50.937149 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba00e79a-d1cd-4b27-b81b-12d4578f6991 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:50.937760 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba00e79a-d1cd-4b27-b81b-12d4578f6991 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:50.938346 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba00e79a-d1cd-4b27-b81b-12d4578f6991 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:51.169319 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ba00e79a-d1cd-4b27-b81b-12d4578f6991 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:51.177249 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ba00e79a-d1cd-4b27-b81b-12d4578f6991 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.256605 Aug 18 14:26:51.178045 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 128/252] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:50 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:51.486482 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aee32721-aa15-45d0-9870-9eba883697fd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:51.487114 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aee32721-aa15-45d0-9870-9eba883697fd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:51.495817 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aee32721-aa15-45d0-9870-9eba883697fd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:51.496301 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aee32721-aa15-45d0-9870-9eba883697fd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:51.496739 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aee32721-aa15-45d0-9870-9eba883697fd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:51.497429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aee32721-aa15-45d0-9870-9eba883697fd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:51.498226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aee32721-aa15-45d0-9870-9eba883697fd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:51.498461 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aee32721-aa15-45d0-9870-9eba883697fd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:51.650615 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aee32721-aa15-45d0-9870-9eba883697fd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:51.660287 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aee32721-aa15-45d0-9870-9eba883697fd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:51.661840 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aee32721-aa15-45d0-9870-9eba883697fd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:51.662960 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aee32721-aa15-45d0-9870-9eba883697fd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.180567 Aug 18 14:26:51.664073 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 125/253] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:51 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:51.853561 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0b5dbc8f-9a85-462b-8a0c-9b88963c021e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:51.854563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0b5dbc8f-9a85-462b-8a0c-9b88963c021e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:51.862419 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b5dbc8f-9a85-462b-8a0c-9b88963c021e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:51.862905 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b5dbc8f-9a85-462b-8a0c-9b88963c021e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:51.863340 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b5dbc8f-9a85-462b-8a0c-9b88963c021e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:51.864058 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b5dbc8f-9a85-462b-8a0c-9b88963c021e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:51.864516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b5dbc8f-9a85-462b-8a0c-9b88963c021e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:51.864941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b5dbc8f-9a85-462b-8a0c-9b88963c021e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:52.066300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0b5dbc8f-9a85-462b-8a0c-9b88963c021e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:52.068609 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:52.076473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0b5dbc8f-9a85-462b-8a0c-9b88963c021e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1313 microversion: 2.1 time: 0.230231 Aug 18 14:26:52.077066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 129/254] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:51 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:52.199806 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a86b68c2-6c1c-41b3-bbcf-acf88145f99d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:52.200762 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a86b68c2-6c1c-41b3-bbcf-acf88145f99d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:52.207012 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a86b68c2-6c1c-41b3-bbcf-acf88145f99d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:52.207542 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a86b68c2-6c1c-41b3-bbcf-acf88145f99d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:52.207977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a86b68c2-6c1c-41b3-bbcf-acf88145f99d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:52.208675 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a86b68c2-6c1c-41b3-bbcf-acf88145f99d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:52.209122 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a86b68c2-6c1c-41b3-bbcf-acf88145f99d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:52.209720 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a86b68c2-6c1c-41b3-bbcf-acf88145f99d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:52.355679 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a86b68c2-6c1c-41b3-bbcf-acf88145f99d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:52.362179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a86b68c2-6c1c-41b3-bbcf-acf88145f99d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.167998 Aug 18 14:26:52.362766 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 126/255] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:52 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:52.595613 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-a86cea04-d0da-49be-b3bb-9e99c7b09147 req-6013afd7-8f78-4090-aaec-943945d6829a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "663d1c02-1a91-404f-a18c-7dc5fad12b48", "tag": "fb5d5dce-0bf2-4d31-a227-43535f9e7374"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:52.606311 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-a86cea04-d0da-49be-b3bb-9e99c7b09147 req-6013afd7-8f78-4090-aaec-943945d6829a service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:52.606789 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-a86cea04-d0da-49be-b3bb-9e99c7b09147 req-6013afd7-8f78-4090-aaec-943945d6829a service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:52.607219 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-a86cea04-d0da-49be-b3bb-9e99c7b09147 req-6013afd7-8f78-4090-aaec-943945d6829a service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:52.618612 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-a86cea04-d0da-49be-b3bb-9e99c7b09147 req-6013afd7-8f78-4090-aaec-943945d6829a service nova] Creating event network-changed:fb5d5dce-0bf2-4d31-a227-43535f9e7374 for instance 663d1c02-1a91-404f-a18c-7dc5fad12b48 on hv-cinder-85220 Aug 18 14:26:52.623464 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-a86cea04-d0da-49be-b3bb-9e99c7b09147 req-6013afd7-8f78-4090-aaec-943945d6829a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033715 Aug 18 14:26:52.624055 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 130/256] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:26:52.686255 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ebe8317d-0cd8-49a6-aa10-fb56bbee2ff5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:52.686865 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ebe8317d-0cd8-49a6-aa10-fb56bbee2ff5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:52.693246 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebe8317d-0cd8-49a6-aa10-fb56bbee2ff5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:52.693729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebe8317d-0cd8-49a6-aa10-fb56bbee2ff5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:52.694166 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebe8317d-0cd8-49a6-aa10-fb56bbee2ff5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:52.695582 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebe8317d-0cd8-49a6-aa10-fb56bbee2ff5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:52.696040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebe8317d-0cd8-49a6-aa10-fb56bbee2ff5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:52.696544 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebe8317d-0cd8-49a6-aa10-fb56bbee2ff5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:52.833012 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ebe8317d-0cd8-49a6-aa10-fb56bbee2ff5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:52.843049 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ebe8317d-0cd8-49a6-aa10-fb56bbee2ff5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:52.845019 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ebe8317d-0cd8-49a6-aa10-fb56bbee2ff5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:52.846153 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ebe8317d-0cd8-49a6-aa10-fb56bbee2ff5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1405 microversion: 2.20 time: 0.163837 Aug 18 14:26:52.846723 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 127/257] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:52 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:53.099262 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f90e2654-fb5a-47d8-a50d-87898cc57a1b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:53.100161 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f90e2654-fb5a-47d8-a50d-87898cc57a1b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:53.109376 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f90e2654-fb5a-47d8-a50d-87898cc57a1b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:53.109879 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f90e2654-fb5a-47d8-a50d-87898cc57a1b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:53.110441 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f90e2654-fb5a-47d8-a50d-87898cc57a1b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:53.111432 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f90e2654-fb5a-47d8-a50d-87898cc57a1b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:53.112162 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f90e2654-fb5a-47d8-a50d-87898cc57a1b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:53.112897 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f90e2654-fb5a-47d8-a50d-87898cc57a1b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:53.140043 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dc0a0cd1-8eb0-4bbf-a1a1-7a3bcfa2a44d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:53.140767 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dc0a0cd1-8eb0-4bbf-a1a1-7a3bcfa2a44d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:53.149554 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc0a0cd1-8eb0-4bbf-a1a1-7a3bcfa2a44d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:53.150060 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc0a0cd1-8eb0-4bbf-a1a1-7a3bcfa2a44d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:53.151546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc0a0cd1-8eb0-4bbf-a1a1-7a3bcfa2a44d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:53.152254 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc0a0cd1-8eb0-4bbf-a1a1-7a3bcfa2a44d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:53.153807 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc0a0cd1-8eb0-4bbf-a1a1-7a3bcfa2a44d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:53.154248 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc0a0cd1-8eb0-4bbf-a1a1-7a3bcfa2a44d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:53.184111 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dc0a0cd1-8eb0-4bbf-a1a1-7a3bcfa2a44d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/ips" status: 200 len: 149 microversion: 2.1 time: 0.060322 Aug 18 14:26:53.191704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 128/258] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Aug 18 14:26:53 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/ips => generated 149 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:26:53.348344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f90e2654-fb5a-47d8-a50d-87898cc57a1b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:53.361469 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f90e2654-fb5a-47d8-a50d-87898cc57a1b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1313 microversion: 2.1 time: 0.267022 Aug 18 14:26:53.372097 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 131/259] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:53 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:53.387184 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c0f014c3-aa2a-4a5e-a6bf-ec10285b6eff tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:53.388270 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c0f014c3-aa2a-4a5e-a6bf-ec10285b6eff tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:53.396938 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0f014c3-aa2a-4a5e-a6bf-ec10285b6eff tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:53.397449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0f014c3-aa2a-4a5e-a6bf-ec10285b6eff tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:53.398094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0f014c3-aa2a-4a5e-a6bf-ec10285b6eff tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:53.399601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0f014c3-aa2a-4a5e-a6bf-ec10285b6eff tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:53.400128 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0f014c3-aa2a-4a5e-a6bf-ec10285b6eff tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:53.401042 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0f014c3-aa2a-4a5e-a6bf-ec10285b6eff tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:53.597568 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c0f014c3-aa2a-4a5e-a6bf-ec10285b6eff tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:53.607008 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c0f014c3-aa2a-4a5e-a6bf-ec10285b6eff tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.226599 Aug 18 14:26:53.607621 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 129/260] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:53 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:53.871528 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b15b0506-c7b8-41b5-8848-98d9a1d6028a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:53.872054 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b15b0506-c7b8-41b5-8848-98d9a1d6028a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:53.877933 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b15b0506-c7b8-41b5-8848-98d9a1d6028a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:53.878415 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b15b0506-c7b8-41b5-8848-98d9a1d6028a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:53.878851 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b15b0506-c7b8-41b5-8848-98d9a1d6028a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:53.879572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b15b0506-c7b8-41b5-8848-98d9a1d6028a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:53.880028 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b15b0506-c7b8-41b5-8848-98d9a1d6028a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:53.880451 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b15b0506-c7b8-41b5-8848-98d9a1d6028a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:54.015566 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b15b0506-c7b8-41b5-8848-98d9a1d6028a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:54.025016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b15b0506-c7b8-41b5-8848-98d9a1d6028a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:54.026559 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b15b0506-c7b8-41b5-8848-98d9a1d6028a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:54.027760 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b15b0506-c7b8-41b5-8848-98d9a1d6028a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1597 microversion: 2.20 time: 0.161211 Aug 18 14:26:54.028344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 132/261] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:26:53 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1597 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:26:54.051671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-17504b05-a523-4791-9ae9-08a3b709ebbe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:54.052373 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-17504b05-a523-4791-9ae9-08a3b709ebbe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:54.058408 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-17504b05-a523-4791-9ae9-08a3b709ebbe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:54.058886 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-17504b05-a523-4791-9ae9-08a3b709ebbe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:54.059321 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-17504b05-a523-4791-9ae9-08a3b709ebbe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:54.060041 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-17504b05-a523-4791-9ae9-08a3b709ebbe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:54.060495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-17504b05-a523-4791-9ae9-08a3b709ebbe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:54.060915 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-17504b05-a523-4791-9ae9-08a3b709ebbe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:54.139052 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-17504b05-a523-4791-9ae9-08a3b709ebbe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091364 Aug 18 14:26:54.139693 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 130/262] 10.222.0.39 () {60 vars in 1316 bytes} [Thu Aug 18 14:26:54 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:26:54.385572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2f22eb6d-a53a-49e5-b1b9-2a150902594f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:54.386255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2f22eb6d-a53a-49e5-b1b9-2a150902594f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:54.392909 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f22eb6d-a53a-49e5-b1b9-2a150902594f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:54.393568 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f22eb6d-a53a-49e5-b1b9-2a150902594f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:54.394326 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f22eb6d-a53a-49e5-b1b9-2a150902594f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:54.395650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f22eb6d-a53a-49e5-b1b9-2a150902594f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:54.396570 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f22eb6d-a53a-49e5-b1b9-2a150902594f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:54.397331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f22eb6d-a53a-49e5-b1b9-2a150902594f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:54.566033 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2f22eb6d-a53a-49e5-b1b9-2a150902594f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:54.574403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2f22eb6d-a53a-49e5-b1b9-2a150902594f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1313 microversion: 2.1 time: 0.193156 Aug 18 14:26:54.575107 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 133/263] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:54 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:54.633138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d21439e-6e8f-4db5-a800-8f72f661144f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:54.633923 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1d21439e-6e8f-4db5-a800-8f72f661144f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:54.642916 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d21439e-6e8f-4db5-a800-8f72f661144f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:54.643337 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d21439e-6e8f-4db5-a800-8f72f661144f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:54.644082 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d21439e-6e8f-4db5-a800-8f72f661144f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:54.645004 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d21439e-6e8f-4db5-a800-8f72f661144f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:54.645305 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d21439e-6e8f-4db5-a800-8f72f661144f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:54.645804 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d21439e-6e8f-4db5-a800-8f72f661144f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:54.673972 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:54.761844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a2a70a6e-74d5-4e54-8a3c-9853a4a12514 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8487ce6f-1020-416c-a636-52d38f01b805"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:54.765460 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a2a70a6e-74d5-4e54-8a3c-9853a4a12514 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:54.771887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2a70a6e-74d5-4e54-8a3c-9853a4a12514 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:54.772378 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2a70a6e-74d5-4e54-8a3c-9853a4a12514 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:54.773492 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2a70a6e-74d5-4e54-8a3c-9853a4a12514 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:54.774684 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2a70a6e-74d5-4e54-8a3c-9853a4a12514 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:54.775297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2a70a6e-74d5-4e54-8a3c-9853a4a12514 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:54.776001 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2a70a6e-74d5-4e54-8a3c-9853a4a12514 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:55.043276 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1d21439e-6e8f-4db5-a800-8f72f661144f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:55.055177 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1d21439e-6e8f-4db5-a800-8f72f661144f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.427898 Aug 18 14:26:55.056990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 131/264] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:54 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:55.223047 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a2a70a6e-74d5-4e54-8a3c-9853a4a12514 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "POST /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466290 Aug 18 14:26:55.223700 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 134/265] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:26:54 2022] POST /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments => generated 194 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:26:55.596312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-933eb0a9-2604-4429-be70-6f256486292f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:55.598021 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-933eb0a9-2604-4429-be70-6f256486292f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:55.611940 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-933eb0a9-2604-4429-be70-6f256486292f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:55.612820 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-933eb0a9-2604-4429-be70-6f256486292f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:55.613312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-933eb0a9-2604-4429-be70-6f256486292f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:55.614228 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-933eb0a9-2604-4429-be70-6f256486292f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:55.614748 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-933eb0a9-2604-4429-be70-6f256486292f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:55.615173 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-933eb0a9-2604-4429-be70-6f256486292f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:56.080576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-85f7a165-6fde-48e4-819b-c969c3b8ab34 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:56.081648 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-85f7a165-6fde-48e4-819b-c969c3b8ab34 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:56.094655 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85f7a165-6fde-48e4-819b-c969c3b8ab34 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:56.095524 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85f7a165-6fde-48e4-819b-c969c3b8ab34 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:56.096253 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85f7a165-6fde-48e4-819b-c969c3b8ab34 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:56.098161 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85f7a165-6fde-48e4-819b-c969c3b8ab34 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:56.098860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85f7a165-6fde-48e4-819b-c969c3b8ab34 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:56.099798 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85f7a165-6fde-48e4-819b-c969c3b8ab34 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:56.137641 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-933eb0a9-2604-4429-be70-6f256486292f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:56.148619 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-933eb0a9-2604-4429-be70-6f256486292f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1313 microversion: 2.1 time: 0.556863 Aug 18 14:26:56.156070 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 132/266] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:55 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1313 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:56.187902 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-1a5e7ddd-170a-47a2-b672-d4a0c164f8b2 req-c217acf6-0b6a-48d8-804d-02614ceddedb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d09be0-5622-4167-859a-c81e38fc7218", "tag": "ce6e4f0c-73f1-4b80-9e83-e467ad9ba266"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:56.200678 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1a5e7ddd-170a-47a2-b672-d4a0c164f8b2 req-c217acf6-0b6a-48d8-804d-02614ceddedb service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:56.202785 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1a5e7ddd-170a-47a2-b672-d4a0c164f8b2 req-c217acf6-0b6a-48d8-804d-02614ceddedb service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:56.203518 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1a5e7ddd-170a-47a2-b672-d4a0c164f8b2 req-c217acf6-0b6a-48d8-804d-02614ceddedb service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:56.218140 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-1a5e7ddd-170a-47a2-b672-d4a0c164f8b2 req-c217acf6-0b6a-48d8-804d-02614ceddedb service nova] Creating event network-changed:ce6e4f0c-73f1-4b80-9e83-e467ad9ba266 for instance 95d09be0-5622-4167-859a-c81e38fc7218 on hv-cinder-85220 Aug 18 14:26:56.226288 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-1a5e7ddd-170a-47a2-b672-d4a0c164f8b2 req-c217acf6-0b6a-48d8-804d-02614ceddedb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042709 Aug 18 14:26:56.228038 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 133/267] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:26:56.801847 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-85f7a165-6fde-48e4-819b-c969c3b8ab34 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:56.813070 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-85f7a165-6fde-48e4-819b-c969c3b8ab34 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.736353 Aug 18 14:26:56.813996 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 135/268] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:56 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:57.185053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8eb3e8db-35af-42c1-8884-227dddb02b95 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:57.186759 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8eb3e8db-35af-42c1-8884-227dddb02b95 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:57.197096 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eb3e8db-35af-42c1-8884-227dddb02b95 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:57.198329 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eb3e8db-35af-42c1-8884-227dddb02b95 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:57.202528 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eb3e8db-35af-42c1-8884-227dddb02b95 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:57.205113 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eb3e8db-35af-42c1-8884-227dddb02b95 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:57.207435 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eb3e8db-35af-42c1-8884-227dddb02b95 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:57.209790 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eb3e8db-35af-42c1-8884-227dddb02b95 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:57.494908 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8eb3e8db-35af-42c1-8884-227dddb02b95 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:57.503744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8eb3e8db-35af-42c1-8884-227dddb02b95 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1313 microversion: 2.1 time: 0.322994 Aug 18 14:26:57.504542 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 134/269] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:57 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:57.833178 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d7ee08bb-b98d-47d3-acf6-25277bc72913 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:57.834660 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d7ee08bb-b98d-47d3-acf6-25277bc72913 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:57.843789 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7ee08bb-b98d-47d3-acf6-25277bc72913 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:57.844828 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7ee08bb-b98d-47d3-acf6-25277bc72913 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:57.845263 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7ee08bb-b98d-47d3-acf6-25277bc72913 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:57.845959 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7ee08bb-b98d-47d3-acf6-25277bc72913 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:57.846896 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7ee08bb-b98d-47d3-acf6-25277bc72913 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:57.847338 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7ee08bb-b98d-47d3-acf6-25277bc72913 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:58.009873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d7ee08bb-b98d-47d3-acf6-25277bc72913 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:58.020104 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d7ee08bb-b98d-47d3-acf6-25277bc72913 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1500 microversion: 2.1 time: 0.190695 Aug 18 14:26:58.021211 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 136/270] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:57 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1500 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:58.047871 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b2164387-18b8-44f9-89c4-afa32825625a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a3e4360-f428-45f3-9d81-d818a743a296"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:58.050169 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b2164387-18b8-44f9-89c4-afa32825625a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:58.056616 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2164387-18b8-44f9-89c4-afa32825625a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:58.057413 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2164387-18b8-44f9-89c4-afa32825625a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:58.058178 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2164387-18b8-44f9-89c4-afa32825625a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:58.058967 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2164387-18b8-44f9-89c4-afa32825625a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:58.059523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2164387-18b8-44f9-89c4-afa32825625a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:58.060016 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2164387-18b8-44f9-89c4-afa32825625a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:58.083985 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-b2164387-18b8-44f9-89c4-afa32825625a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] HTTP exception thrown: Cannot 'attach_volume' instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 while it is in vm_state rescued Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b2164387-18b8-44f9-89c4-afa32825625a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Request method failure captured: Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: POST /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5/os-volume_attachments HTTP/1.1 Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 74 Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvDrlAzVmK2YGq_eda07azj0Q5wXK5WMqshAENCB_sdiRt9OENbPVNax3o1QeEbjwKoARV5nzkWWp3C1qz5fFGCEUdhnGLYo5jhlagdb1rEhpPqpOmG3k-UOWefsZlXkDNPL-7u5L9-Nt41h7CA3ghNp-8pAcB0qSc9vAvc1V_hPkw Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: e39a8bb94bfb417b951e4f66473fa900 Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:26:58.086744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:26:58.088312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:26:58.088312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:26:58.088312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: e39a8bb94bfb417b951e4f66473fa900 Aug 18 14:26:58.088312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:26:58.088312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-ServerRescueNegativeTestJSON-127563257-project Aug 18 14:26:58.088312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:26:58.088312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:26:58.088312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 12e95dabd6f04cd9818a77f27b34d927 Aug 18 14:26:58.088312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-127563257-project Aug 18 14:26:58.088312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Aug 18 14:26:58.088312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {"volumeAttachment": {"volumeId": "6a3e4360-f428-45f3-9d81-d818a743a296"}} Aug 18 14:26:58.088312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Cannot 'attach_volume' instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 while it is in vm_state rescued Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'server_id': '222bc1f0-96b3-4d29-960a-39437b4dc0a5', 'body': {'volumeAttachment': {'volumeId': '6a3e4360-f428-45f3-9d81-d818a743a296'}}} Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:26:58.089204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 while it is in vm_state rescued Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:26:58.090600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:26:58.092551 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:26:58.092551 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:26:58.092551 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 while it is in vm_state rescued Aug 18 14:26:58.092551 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:26:58.092551 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b2164387-18b8-44f9-89c4-afa32825625a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Returning 409 to user: Cannot 'attach_volume' instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 while it is in vm_state rescued {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:26:58.093270 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b2164387-18b8-44f9-89c4-afa32825625a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "POST /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055798 Aug 18 14:26:58.093850 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 135/271] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:26:58 2022] POST /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 14:26:58.103195 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6bc4b4cc-7b7d-4092-be21-62215820c4d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:58.104178 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6bc4b4cc-7b7d-4092-be21-62215820c4d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:58.113078 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bc4b4cc-7b7d-4092-be21-62215820c4d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:58.113634 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bc4b4cc-7b7d-4092-be21-62215820c4d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:58.114185 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bc4b4cc-7b7d-4092-be21-62215820c4d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:58.114970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bc4b4cc-7b7d-4092-be21-62215820c4d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:58.115521 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bc4b4cc-7b7d-4092-be21-62215820c4d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:58.116012 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bc4b4cc-7b7d-4092-be21-62215820c4d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:58.216627 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6bc4b4cc-7b7d-4092-be21-62215820c4d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "POST /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5/action" status: 202 len: 0 microversion: 2.1 time: 0.117311 Aug 18 14:26:58.217278 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 137/272] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:26:58 2022] POST /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:26:58.226359 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-45572c2e-48f0-41ad-8e5f-1964741fe63d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:58.226766 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-45572c2e-48f0-41ad-8e5f-1964741fe63d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:58.233830 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45572c2e-48f0-41ad-8e5f-1964741fe63d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:58.234415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45572c2e-48f0-41ad-8e5f-1964741fe63d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:58.235128 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45572c2e-48f0-41ad-8e5f-1964741fe63d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:58.236220 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45572c2e-48f0-41ad-8e5f-1964741fe63d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:58.236829 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45572c2e-48f0-41ad-8e5f-1964741fe63d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:58.239020 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45572c2e-48f0-41ad-8e5f-1964741fe63d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:58.528825 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-45572c2e-48f0-41ad-8e5f-1964741fe63d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:58.529035 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1fab000b-9c83-484f-84de-d29f6c1ebfc1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:58.529235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1fab000b-9c83-484f-84de-d29f6c1ebfc1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:58.538860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fab000b-9c83-484f-84de-d29f6c1ebfc1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:58.539623 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fab000b-9c83-484f-84de-d29f6c1ebfc1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:58.540356 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fab000b-9c83-484f-84de-d29f6c1ebfc1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:58.542382 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fab000b-9c83-484f-84de-d29f6c1ebfc1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:58.543235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fab000b-9c83-484f-84de-d29f6c1ebfc1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:58.543887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fab000b-9c83-484f-84de-d29f6c1ebfc1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:58.550613 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-45572c2e-48f0-41ad-8e5f-1964741fe63d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1508 microversion: 2.1 time: 0.326087 Aug 18 14:26:58.551343 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 136/273] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:58 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1508 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:26:58.576399 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-d543cdea-4c36-47cd-a7e9-084d1f18875a req-60a58835-d4b3-46e9-83cd-5a799908a187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663d1c02-1a91-404f-a18c-7dc5fad12b48", "name": "network-vif-plugged", "status": "completed", "tag": "fb5d5dce-0bf2-4d31-a227-43535f9e7374"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:26:58.608959 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d543cdea-4c36-47cd-a7e9-084d1f18875a req-60a58835-d4b3-46e9-83cd-5a799908a187 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:58.610473 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d543cdea-4c36-47cd-a7e9-084d1f18875a req-60a58835-d4b3-46e9-83cd-5a799908a187 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:58.611003 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d543cdea-4c36-47cd-a7e9-084d1f18875a req-60a58835-d4b3-46e9-83cd-5a799908a187 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:58.637467 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-d543cdea-4c36-47cd-a7e9-084d1f18875a req-60a58835-d4b3-46e9-83cd-5a799908a187 service nova] Creating event network-vif-plugged:fb5d5dce-0bf2-4d31-a227-43535f9e7374 for instance 663d1c02-1a91-404f-a18c-7dc5fad12b48 on hv-cinder-85220 Aug 18 14:26:58.650161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-d543cdea-4c36-47cd-a7e9-084d1f18875a req-60a58835-d4b3-46e9-83cd-5a799908a187 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077369 Aug 18 14:26:58.650838 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 137/274] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:26:58.770398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1fab000b-9c83-484f-84de-d29f6c1ebfc1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:58.781598 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1fab000b-9c83-484f-84de-d29f6c1ebfc1 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1313 microversion: 2.1 time: 0.259154 Aug 18 14:26:58.782703 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 138/275] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:58 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:59.572832 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:59.573713 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:59.578143 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c931c3df-d322-4ca4-8d1e-96bfd17cfde6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:59.578845 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c931c3df-d322-4ca4-8d1e-96bfd17cfde6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:59.586485 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c931c3df-d322-4ca4-8d1e-96bfd17cfde6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:59.586966 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c931c3df-d322-4ca4-8d1e-96bfd17cfde6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:59.587423 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c931c3df-d322-4ca4-8d1e-96bfd17cfde6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:59.588114 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c931c3df-d322-4ca4-8d1e-96bfd17cfde6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:59.588564 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c931c3df-d322-4ca4-8d1e-96bfd17cfde6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:59.588989 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c931c3df-d322-4ca4-8d1e-96bfd17cfde6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:59.737336 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c931c3df-d322-4ca4-8d1e-96bfd17cfde6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:26:59.747124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c931c3df-d322-4ca4-8d1e-96bfd17cfde6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1508 microversion: 2.1 time: 0.175350 Aug 18 14:26:59.747732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 138/276] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:59 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:26:59.804809 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c03ef42c-f6f2-4d96-97e3-bb8d07044d38 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:26:59.805612 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c03ef42c-f6f2-4d96-97e3-bb8d07044d38 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:26:59.809000 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:26:59.815399 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c03ef42c-f6f2-4d96-97e3-bb8d07044d38 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:59.816597 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c03ef42c-f6f2-4d96-97e3-bb8d07044d38 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:59.816960 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c03ef42c-f6f2-4d96-97e3-bb8d07044d38 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:26:59.818321 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c03ef42c-f6f2-4d96-97e3-bb8d07044d38 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:26:59.818835 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c03ef42c-f6f2-4d96-97e3-bb8d07044d38 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:26:59.820116 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c03ef42c-f6f2-4d96-97e3-bb8d07044d38 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:00.015617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c03ef42c-f6f2-4d96-97e3-bb8d07044d38 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:00.026244 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c03ef42c-f6f2-4d96-97e3-bb8d07044d38 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1313 microversion: 2.1 time: 0.226997 Aug 18 14:27:00.026823 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 139/277] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:26:59 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:00.768494 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-52276d81-4b88-4ae4-927e-8df8dbe7acdc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:00.769117 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-52276d81-4b88-4ae4-927e-8df8dbe7acdc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:00.775822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52276d81-4b88-4ae4-927e-8df8dbe7acdc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:00.776306 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52276d81-4b88-4ae4-927e-8df8dbe7acdc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:00.776746 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52276d81-4b88-4ae4-927e-8df8dbe7acdc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:00.777439 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52276d81-4b88-4ae4-927e-8df8dbe7acdc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:00.777898 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52276d81-4b88-4ae4-927e-8df8dbe7acdc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:00.778324 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52276d81-4b88-4ae4-927e-8df8dbe7acdc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:00.909644 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-52276d81-4b88-4ae4-927e-8df8dbe7acdc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:00.918375 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-52276d81-4b88-4ae4-927e-8df8dbe7acdc tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1508 microversion: 2.1 time: 0.153614 Aug 18 14:27:00.918991 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 139/278] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:00 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:01.047750 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7b5ac5e2-4c2e-4cd9-bc47-f659137c5ab9 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:01.048371 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7b5ac5e2-4c2e-4cd9-bc47-f659137c5ab9 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:01.054899 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b5ac5e2-4c2e-4cd9-bc47-f659137c5ab9 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:01.055394 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b5ac5e2-4c2e-4cd9-bc47-f659137c5ab9 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:01.055886 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b5ac5e2-4c2e-4cd9-bc47-f659137c5ab9 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:01.056577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b5ac5e2-4c2e-4cd9-bc47-f659137c5ab9 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:01.057035 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b5ac5e2-4c2e-4cd9-bc47-f659137c5ab9 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:01.057461 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b5ac5e2-4c2e-4cd9-bc47-f659137c5ab9 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:01.183129 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7b5ac5e2-4c2e-4cd9-bc47-f659137c5ab9 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:01.190779 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7b5ac5e2-4c2e-4cd9-bc47-f659137c5ab9 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1313 microversion: 2.1 time: 0.147452 Aug 18 14:27:01.191349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 140/279] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:01 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:01.939382 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fd828db0-c73c-4e5a-813d-c42f8f3f06de tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:01.939991 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fd828db0-c73c-4e5a-813d-c42f8f3f06de tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:01.946222 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd828db0-c73c-4e5a-813d-c42f8f3f06de tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:01.946699 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd828db0-c73c-4e5a-813d-c42f8f3f06de tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:01.947128 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd828db0-c73c-4e5a-813d-c42f8f3f06de tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:01.947840 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd828db0-c73c-4e5a-813d-c42f8f3f06de tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:01.948287 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd828db0-c73c-4e5a-813d-c42f8f3f06de tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:01.948704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd828db0-c73c-4e5a-813d-c42f8f3f06de tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:02.082185 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fd828db0-c73c-4e5a-813d-c42f8f3f06de tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:02.090259 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fd828db0-c73c-4e5a-813d-c42f8f3f06de tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1508 microversion: 2.1 time: 0.154630 Aug 18 14:27:02.091022 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 140/280] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:01 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:02.212874 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-53035e7c-f98e-45d1-8582-1b3960464530 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:02.213482 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-53035e7c-f98e-45d1-8582-1b3960464530 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:02.220096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53035e7c-f98e-45d1-8582-1b3960464530 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:02.220574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53035e7c-f98e-45d1-8582-1b3960464530 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:02.221001 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53035e7c-f98e-45d1-8582-1b3960464530 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:02.221679 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53035e7c-f98e-45d1-8582-1b3960464530 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:02.222126 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53035e7c-f98e-45d1-8582-1b3960464530 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:02.222546 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53035e7c-f98e-45d1-8582-1b3960464530 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:02.355991 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-53035e7c-f98e-45d1-8582-1b3960464530 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:02.363678 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-53035e7c-f98e-45d1-8582-1b3960464530 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1313 microversion: 2.1 time: 0.155518 Aug 18 14:27:02.364235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 141/281] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:02 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:03.112271 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-13917432-890b-4ea8-9796-94548862251b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:03.112958 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-13917432-890b-4ea8-9796-94548862251b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:03.119730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13917432-890b-4ea8-9796-94548862251b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:03.120216 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13917432-890b-4ea8-9796-94548862251b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:03.120651 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13917432-890b-4ea8-9796-94548862251b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:03.121335 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13917432-890b-4ea8-9796-94548862251b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:03.121788 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13917432-890b-4ea8-9796-94548862251b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:03.122210 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13917432-890b-4ea8-9796-94548862251b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:03.255871 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-13917432-890b-4ea8-9796-94548862251b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:03.264680 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-13917432-890b-4ea8-9796-94548862251b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1508 microversion: 2.1 time: 0.156467 Aug 18 14:27:03.265245 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 141/282] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:03 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:03.384137 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-171fee8e-c537-4432-9e6c-27e075296ac2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:03.384755 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-171fee8e-c537-4432-9e6c-27e075296ac2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:03.391174 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-171fee8e-c537-4432-9e6c-27e075296ac2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:03.391688 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-171fee8e-c537-4432-9e6c-27e075296ac2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:03.392128 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-171fee8e-c537-4432-9e6c-27e075296ac2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:03.392835 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-171fee8e-c537-4432-9e6c-27e075296ac2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:03.393283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-171fee8e-c537-4432-9e6c-27e075296ac2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:03.393710 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-171fee8e-c537-4432-9e6c-27e075296ac2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:03.527195 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-171fee8e-c537-4432-9e6c-27e075296ac2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:03.534795 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-171fee8e-c537-4432-9e6c-27e075296ac2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1313 microversion: 2.1 time: 0.154664 Aug 18 14:27:03.535359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 142/283] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:03 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:04.285552 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-544450e4-5fd9-4b64-b68a-7bfc521a34d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:04.286168 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-544450e4-5fd9-4b64-b68a-7bfc521a34d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:04.292292 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-544450e4-5fd9-4b64-b68a-7bfc521a34d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:04.292772 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-544450e4-5fd9-4b64-b68a-7bfc521a34d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:04.293206 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-544450e4-5fd9-4b64-b68a-7bfc521a34d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:04.293890 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-544450e4-5fd9-4b64-b68a-7bfc521a34d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:04.294341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-544450e4-5fd9-4b64-b68a-7bfc521a34d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:04.294761 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-544450e4-5fd9-4b64-b68a-7bfc521a34d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:04.556933 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-544450e4-5fd9-4b64-b68a-7bfc521a34d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:04.557311 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-236e6030-0d29-4b5e-8bab-a28ed8695a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:04.558031 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-236e6030-0d29-4b5e-8bab-a28ed8695a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:04.560503 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=82 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:04.565013 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-544450e4-5fd9-4b64-b68a-7bfc521a34d9 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1514 microversion: 2.1 time: 0.283191 Aug 18 14:27:04.565574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 142/284] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:04 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:04.565760 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-236e6030-0d29-4b5e-8bab-a28ed8695a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:04.566239 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-236e6030-0d29-4b5e-8bab-a28ed8695a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:04.566727 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-236e6030-0d29-4b5e-8bab-a28ed8695a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:04.567437 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-236e6030-0d29-4b5e-8bab-a28ed8695a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:04.567887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-236e6030-0d29-4b5e-8bab-a28ed8695a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:04.568301 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-236e6030-0d29-4b5e-8bab-a28ed8695a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:04.698073 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-236e6030-0d29-4b5e-8bab-a28ed8695a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:04.706667 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-236e6030-0d29-4b5e-8bab-a28ed8695a6e tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1313 microversion: 2.1 time: 0.154078 Aug 18 14:27:04.707414 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 143/285] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:04 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:27:05.728212 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c90be0b5-bfda-4538-90e2-17a393cd0a15 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:05.728828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c90be0b5-bfda-4538-90e2-17a393cd0a15 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:05.734792 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c90be0b5-bfda-4538-90e2-17a393cd0a15 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:05.735308 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c90be0b5-bfda-4538-90e2-17a393cd0a15 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:05.735773 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c90be0b5-bfda-4538-90e2-17a393cd0a15 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:05.736461 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c90be0b5-bfda-4538-90e2-17a393cd0a15 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:05.736917 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c90be0b5-bfda-4538-90e2-17a393cd0a15 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:05.737340 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c90be0b5-bfda-4538-90e2-17a393cd0a15 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:05.864327 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c90be0b5-bfda-4538-90e2-17a393cd0a15 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:05.872712 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c90be0b5-bfda-4538-90e2-17a393cd0a15 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1313 microversion: 2.1 time: 0.148323 Aug 18 14:27:05.873473 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 143/286] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:05 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:06.893413 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d68f7629-96ea-4f03-88cf-f060a0de5adb tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:06.894018 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d68f7629-96ea-4f03-88cf-f060a0de5adb tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:06.900612 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d68f7629-96ea-4f03-88cf-f060a0de5adb tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:06.901273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d68f7629-96ea-4f03-88cf-f060a0de5adb tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:06.901712 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d68f7629-96ea-4f03-88cf-f060a0de5adb tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:06.902391 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d68f7629-96ea-4f03-88cf-f060a0de5adb tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:06.902838 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d68f7629-96ea-4f03-88cf-f060a0de5adb tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:06.903259 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d68f7629-96ea-4f03-88cf-f060a0de5adb tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:07.037988 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d68f7629-96ea-4f03-88cf-f060a0de5adb tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:07.040784 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:07.048376 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d68f7629-96ea-4f03-88cf-f060a0de5adb tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1313 microversion: 2.1 time: 0.158771 Aug 18 14:27:07.048956 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 144/287] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:06 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:08.071119 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4b1ad9c1-15e6-4638-b1bd-2622a8190137 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:08.071757 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4b1ad9c1-15e6-4638-b1bd-2622a8190137 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:08.077677 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b1ad9c1-15e6-4638-b1bd-2622a8190137 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:08.078159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b1ad9c1-15e6-4638-b1bd-2622a8190137 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:08.078593 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b1ad9c1-15e6-4638-b1bd-2622a8190137 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:08.079287 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b1ad9c1-15e6-4638-b1bd-2622a8190137 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:08.079768 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b1ad9c1-15e6-4638-b1bd-2622a8190137 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:08.080203 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b1ad9c1-15e6-4638-b1bd-2622a8190137 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:08.221195 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4b1ad9c1-15e6-4638-b1bd-2622a8190137 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:08.228911 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4b1ad9c1-15e6-4638-b1bd-2622a8190137 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1497 microversion: 2.1 time: 0.162298 Aug 18 14:27:08.229469 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 144/288] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:08 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:08.811872 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-84553185-b7b5-41ec-9cf5-0fa205bb7524 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:08.812362 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-84553185-b7b5-41ec-9cf5-0fa205bb7524 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:08.820601 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84553185-b7b5-41ec-9cf5-0fa205bb7524 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:08.821347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84553185-b7b5-41ec-9cf5-0fa205bb7524 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:08.822311 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84553185-b7b5-41ec-9cf5-0fa205bb7524 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:08.823357 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84553185-b7b5-41ec-9cf5-0fa205bb7524 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:08.823838 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84553185-b7b5-41ec-9cf5-0fa205bb7524 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:08.824263 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84553185-b7b5-41ec-9cf5-0fa205bb7524 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:08.850295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-84553185-b7b5-41ec-9cf5-0fa205bb7524 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:27:08.925236 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-84553185-b7b5-41ec-9cf5-0fa205bb7524 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "DELETE /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 204 len: 0 microversion: 2.1 time: 0.116941 Aug 18 14:27:08.925800 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 145/289] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:27:08 2022] DELETE /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:27:08.934456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5a205072-1874-48af-a583-ffbcc1bb6f9b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:08.935074 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5a205072-1874-48af-a583-ffbcc1bb6f9b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:08.940998 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a205072-1874-48af-a583-ffbcc1bb6f9b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:08.941477 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a205072-1874-48af-a583-ffbcc1bb6f9b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:08.941910 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a205072-1874-48af-a583-ffbcc1bb6f9b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:08.942593 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a205072-1874-48af-a583-ffbcc1bb6f9b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:08.943044 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a205072-1874-48af-a583-ffbcc1bb6f9b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:08.943505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a205072-1874-48af-a583-ffbcc1bb6f9b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:09.074961 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c0f0221e-5084-4b90-a820-21264fe7786a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Action: 'create', calling method: .version_select at 0x7fb6221934c0>, body: {"keypair": {"name": "tempest-keypair-17524173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw0avSwIytHkYsVSa7S5IU/pKzh0IV/DCqCRRMgeRzQtFSeOIGXCOUtluYmFYWC7jUmm8avliVXDM/EgDH6jtEtwD4JsvYMuDJivSLBi6srj7hOxm9Y2FMtK38ANumdvw=="}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:09.077803 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5a205072-1874-48af-a583-ffbcc1bb6f9b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:09.087557 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5a205072-1874-48af-a583-ffbcc1bb6f9b tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1503 microversion: 2.1 time: 0.156865 Aug 18 14:27:09.088556 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 145/290] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:08 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:09.092367 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-c0f0221e-5084-4b90-a820-21264fe7786a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Getting quotas for project e39a8bb94bfb417b951e4f66473fa900. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:27:09.096611 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-c0f0221e-5084-4b90-a820-21264fe7786a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Getting quotas for user 12e95dabd6f04cd9818a77f27b34d927 and project e39a8bb94bfb417b951e4f66473fa900. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:27:09.122677 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c0f0221e-5084-4b90-a820-21264fe7786a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.052082 Aug 18 14:27:09.123501 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 146/291] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Aug 18 14:27:09 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:27:10.108670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f2390eea-cfaf-4d1b-bf47-d765b6f9a8ed tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:10.109311 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f2390eea-cfaf-4d1b-bf47-d765b6f9a8ed tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:10.111260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:10.117183 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2390eea-cfaf-4d1b-bf47-d765b6f9a8ed tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:10.118030 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2390eea-cfaf-4d1b-bf47-d765b6f9a8ed tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:10.118468 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2390eea-cfaf-4d1b-bf47-d765b6f9a8ed tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:10.119163 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2390eea-cfaf-4d1b-bf47-d765b6f9a8ed tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:10.119650 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2390eea-cfaf-4d1b-bf47-d765b6f9a8ed tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:10.120073 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2390eea-cfaf-4d1b-bf47-d765b6f9a8ed tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:10.325487 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f2390eea-cfaf-4d1b-bf47-d765b6f9a8ed tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:10.333815 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f2390eea-cfaf-4d1b-bf47-d765b6f9a8ed tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1503 microversion: 2.1 time: 0.228894 Aug 18 14:27:10.334839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 146/292] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:10 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:10.663265 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1725435319", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93a3f080-9f42-4a42-bbe6-3276be1407f3"}], "security_groups": [{"name": "tempest-securitygroup--9154398"}], "key_name": "tempest-keypair-17524173", "user_data": "}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:10.823315 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] validate_networks() for [('93a3f080-9f42-4a42-bbe6-3276be1407f3', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:27:11.358735 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aa5292e5-dff1-49bc-96ef-29d1733292b3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:11.361706 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aa5292e5-dff1-49bc-96ef-29d1733292b3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:11.370894 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa5292e5-dff1-49bc-96ef-29d1733292b3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:11.373815 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa5292e5-dff1-49bc-96ef-29d1733292b3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:11.374655 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa5292e5-dff1-49bc-96ef-29d1733292b3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:11.375575 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa5292e5-dff1-49bc-96ef-29d1733292b3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:11.376290 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa5292e5-dff1-49bc-96ef-29d1733292b3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:11.376937 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa5292e5-dff1-49bc-96ef-29d1733292b3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:11.528265 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aa5292e5-dff1-49bc-96ef-29d1733292b3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:11.536894 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aa5292e5-dff1-49bc-96ef-29d1733292b3 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1503 microversion: 2.1 time: 0.185061 Aug 18 14:27:11.537932 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 147/293] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:11 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:11.542949 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-01a2b6b6-6dff-44cc-b46d-8400d4f70fe8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Action: 'create', calling method: .version_select at 0x7fb622a60f70>, body: {"keypair": {"name": "tempest-keypair-2071497103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLza1uyoPWJvGfEL41/GpWQomMEmGYKU6OMzquo19MYmCkgZTQT7xBzAJhNf9z/lPUXUPFMGeSjJk8ISjEYsOd3f7KKOjQxUnx1VRJV88j4hJ3wrkXEsHk8alMD8yCFag=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:11.568122 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-01a2b6b6-6dff-44cc-b46d-8400d4f70fe8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:27:11.574007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-01a2b6b6-6dff-44cc-b46d-8400d4f70fe8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for user 5972d1e96fa04d52983ac6f201d7772c and project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:27:11.620238 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:27:11.620400 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-01a2b6b6-6dff-44cc-b46d-8400d4f70fe8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080764 Aug 18 14:27:11.620793 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:27:11.620937 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 148/294] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Aug 18 14:27:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:27:11.622256 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:27:11.622876 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:27:11.623530 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:27:11.633323 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:11.633876 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:11.634946 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:11.635977 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:11.636730 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:11.637296 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:11.651985 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-154e24aa-c5fa-419a-8729-8b20f787618b req-eeda26fa-5055-4966-91fd-7e4b78e94226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "663d1c02-1a91-404f-a18c-7dc5fad12b48", "name": "network-vif-deleted", "tag": "fb5d5dce-0bf2-4d31-a227-43535f9e7374"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:11.657558 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Getting quotas for project e39a8bb94bfb417b951e4f66473fa900. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:27:11.661872 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Getting quotas for user 12e95dabd6f04cd9818a77f27b34d927 and project e39a8bb94bfb417b951e4f66473fa900. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:27:11.663180 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-154e24aa-c5fa-419a-8729-8b20f787618b req-eeda26fa-5055-4966-91fd-7e4b78e94226 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:11.664399 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-154e24aa-c5fa-419a-8729-8b20f787618b req-eeda26fa-5055-4966-91fd-7e4b78e94226 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:11.664933 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-154e24aa-c5fa-419a-8729-8b20f787618b req-eeda26fa-5055-4966-91fd-7e4b78e94226 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:11.674595 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:27:11.675755 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-154e24aa-c5fa-419a-8729-8b20f787618b req-eeda26fa-5055-4966-91fd-7e4b78e94226 service nova] Creating event network-vif-deleted:fb5d5dce-0bf2-4d31-a227-43535f9e7374 for instance 663d1c02-1a91-404f-a18c-7dc5fad12b48 on hv-cinder-85220 Aug 18 14:27:11.677246 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:27:11.681991 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-154e24aa-c5fa-419a-8729-8b20f787618b req-eeda26fa-5055-4966-91fd-7e4b78e94226 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034328 Aug 18 14:27:11.682871 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 149/295] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:27:11.728763 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-faf2eee1-a5c3-4766-b450-5ca6d66e5b4f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.071689 Aug 18 14:27:11.729995 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 147/296] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:27:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 14:27:11.743742 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-37d69acf-3f46-4c89-80d0-21a93d94b220 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:11.744571 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-37d69acf-3f46-4c89-80d0-21a93d94b220 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:11.821476 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-37d69acf-3f46-4c89-80d0-21a93d94b220 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:11.830177 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-37d69acf-3f46-4c89-80d0-21a93d94b220 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1244 microversion: 2.1 time: 0.091146 Aug 18 14:27:11.842968 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 150/297] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:11 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:12.559330 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1fb7a73f-b238-472e-924d-7107562dd0b5 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:12.559965 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1fb7a73f-b238-472e-924d-7107562dd0b5 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:12.565906 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fb7a73f-b238-472e-924d-7107562dd0b5 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:12.566378 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fb7a73f-b238-472e-924d-7107562dd0b5 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:12.566809 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fb7a73f-b238-472e-924d-7107562dd0b5 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:12.567728 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fb7a73f-b238-472e-924d-7107562dd0b5 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:12.568181 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fb7a73f-b238-472e-924d-7107562dd0b5 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:12.568599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fb7a73f-b238-472e-924d-7107562dd0b5 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:12.638533 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1fb7a73f-b238-472e-924d-7107562dd0b5 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:12.646063 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1fb7a73f-b238-472e-924d-7107562dd0b5 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1461 microversion: 2.1 time: 0.090705 Aug 18 14:27:12.646618 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 148/298] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:12 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1461 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:12.850418 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2c3f5b55-4a8a-4491-8c70-d602718dbd57 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:12.851072 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2c3f5b55-4a8a-4491-8c70-d602718dbd57 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:12.857571 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c3f5b55-4a8a-4491-8c70-d602718dbd57 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:12.858068 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c3f5b55-4a8a-4491-8c70-d602718dbd57 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:12.858510 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c3f5b55-4a8a-4491-8c70-d602718dbd57 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:12.859217 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c3f5b55-4a8a-4491-8c70-d602718dbd57 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:12.859700 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c3f5b55-4a8a-4491-8c70-d602718dbd57 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:12.860137 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c3f5b55-4a8a-4491-8c70-d602718dbd57 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:13.107261 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2c3f5b55-4a8a-4491-8c70-d602718dbd57 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:13.115956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2c3f5b55-4a8a-4491-8c70-d602718dbd57 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1248 microversion: 2.1 time: 0.269254 Aug 18 14:27:13.117373 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 151/299] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:12 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1248 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:13.240629 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1579821350", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce7c320a-581c-4aa3-85bd-1646d1f4ed3c"}], "security_groups": [{"name": "tempest-securitygroup--1817011791"}], "key_name": "tempest-keypair-2071497103", "user_data": "}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:13.344804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] validate_networks() for [('ce7c320a-581c-4aa3-85bd-1646d1f4ed3c', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:27:13.667465 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-93ad4d98-5fe1-4ff3-b4ae-82a27afa12bc tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:13.668085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-93ad4d98-5fe1-4ff3-b4ae-82a27afa12bc tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:13.674063 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93ad4d98-5fe1-4ff3-b4ae-82a27afa12bc tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:13.674546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93ad4d98-5fe1-4ff3-b4ae-82a27afa12bc tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:13.674977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93ad4d98-5fe1-4ff3-b4ae-82a27afa12bc tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:13.675693 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93ad4d98-5fe1-4ff3-b4ae-82a27afa12bc tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:13.676147 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93ad4d98-5fe1-4ff3-b4ae-82a27afa12bc tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:13.676572 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93ad4d98-5fe1-4ff3-b4ae-82a27afa12bc tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:13.694284 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:13.728044 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:27:13.728473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:27:13.728953 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:27:13.729363 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:27:13.729774 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:27:13.738633 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:13.739115 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:13.739587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:13.740309 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:13.740760 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:13.740860 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-93ad4d98-5fe1-4ff3-b4ae-82a27afa12bc tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:13.741184 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:13.749134 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-93ad4d98-5fe1-4ff3-b4ae-82a27afa12bc tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1461 microversion: 2.1 time: 0.086090 Aug 18 14:27:13.749695 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 152/300] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:13 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:27:13.758387 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:27:13.762263 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for user 5972d1e96fa04d52983ac6f201d7772c and project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:27:13.773617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:27:13.775818 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:27:13.821463 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-401cc090-92ae-437f-8df0-f5b855be2b11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.585285 Aug 18 14:27:13.822104 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 149/301] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:27:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:27:13.832901 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c02600f1-7080-4bba-ad6c-9b8e55ac0dbf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:13.833606 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c02600f1-7080-4bba-ad6c-9b8e55ac0dbf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:13.889783 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c02600f1-7080-4bba-ad6c-9b8e55ac0dbf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:13.896818 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c02600f1-7080-4bba-ad6c-9b8e55ac0dbf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1242 microversion: 2.1 time: 0.067927 Aug 18 14:27:13.897384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 153/302] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:13 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:14.138016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fe3c21ad-6c6b-48f7-a9c3-238918da83ea tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:14.138564 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fe3c21ad-6c6b-48f7-a9c3-238918da83ea tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:14.147337 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe3c21ad-6c6b-48f7-a9c3-238918da83ea tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:14.148448 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe3c21ad-6c6b-48f7-a9c3-238918da83ea tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:14.148938 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe3c21ad-6c6b-48f7-a9c3-238918da83ea tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:14.149601 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe3c21ad-6c6b-48f7-a9c3-238918da83ea tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:14.150054 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe3c21ad-6c6b-48f7-a9c3-238918da83ea tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:14.150481 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe3c21ad-6c6b-48f7-a9c3-238918da83ea tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:14.219889 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fe3c21ad-6c6b-48f7-a9c3-238918da83ea tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:14.227682 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fe3c21ad-6c6b-48f7-a9c3-238918da83ea tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1248 microversion: 2.1 time: 0.093797 Aug 18 14:27:14.228263 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 150/303] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:14 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1248 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:14.769680 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:14.770197 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:14.776501 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:14.776977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:14.777406 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:14.778090 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:14.778538 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:14.778955 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:14.809911 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:14.810381 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:14.810810 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:14.811275 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lazy-loading 'fault' on Instance uuid 663d1c02-1a91-404f-a18c-7dc5fad12b48 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:27:14.851740 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:14.859226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-14564ae1-cb2a-4a87-a762-0246aa97a110 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1303 microversion: 2.1 time: 0.093459 Aug 18 14:27:14.859805 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 154/304] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:14 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:14.917587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-51bcb3ac-9610-4657-9f61-5117d8caa891 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:14.918206 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-51bcb3ac-9610-4657-9f61-5117d8caa891 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:14.924707 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51bcb3ac-9610-4657-9f61-5117d8caa891 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:14.925192 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51bcb3ac-9610-4657-9f61-5117d8caa891 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:14.925629 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51bcb3ac-9610-4657-9f61-5117d8caa891 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:14.926342 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51bcb3ac-9610-4657-9f61-5117d8caa891 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:14.926795 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51bcb3ac-9610-4657-9f61-5117d8caa891 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:14.927219 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51bcb3ac-9610-4657-9f61-5117d8caa891 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:14.987628 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-51bcb3ac-9610-4657-9f61-5117d8caa891 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:14.995804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-51bcb3ac-9610-4657-9f61-5117d8caa891 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1238 microversion: 2.1 time: 0.082317 Aug 18 14:27:14.996370 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 151/305] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:14 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:15.248220 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-03d6a472-eca2-4297-a7d9-138b4536ee2d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:15.249441 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-03d6a472-eca2-4297-a7d9-138b4536ee2d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:15.255356 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03d6a472-eca2-4297-a7d9-138b4536ee2d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:15.255865 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03d6a472-eca2-4297-a7d9-138b4536ee2d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:15.256289 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03d6a472-eca2-4297-a7d9-138b4536ee2d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:15.257548 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03d6a472-eca2-4297-a7d9-138b4536ee2d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:15.258333 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03d6a472-eca2-4297-a7d9-138b4536ee2d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:15.258801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03d6a472-eca2-4297-a7d9-138b4536ee2d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:15.318596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-03d6a472-eca2-4297-a7d9-138b4536ee2d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:15.326561 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-03d6a472-eca2-4297-a7d9-138b4536ee2d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1240 microversion: 2.1 time: 0.082141 Aug 18 14:27:15.327119 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 155/306] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:15 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:15.880805 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:15.881338 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:15.887278 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:15.887796 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:15.888234 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:15.888921 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:15.889380 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:15.889803 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:15.919928 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:15.920545 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:15.920821 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:15.921270 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lazy-loading 'fault' on Instance uuid 663d1c02-1a91-404f-a18c-7dc5fad12b48 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:27:15.964966 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:15.972801 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-32993a0e-44e6-4932-90a2-6aeeed56765f tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1303 microversion: 2.1 time: 0.096038 Aug 18 14:27:15.973362 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 152/307] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:15 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:16.017063 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-01ef4b97-2865-4deb-985b-c168165839d9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:16.017680 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-01ef4b97-2865-4deb-985b-c168165839d9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:16.025104 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01ef4b97-2865-4deb-985b-c168165839d9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:16.025584 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01ef4b97-2865-4deb-985b-c168165839d9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:16.026017 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01ef4b97-2865-4deb-985b-c168165839d9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:16.026704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01ef4b97-2865-4deb-985b-c168165839d9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:16.027186 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01ef4b97-2865-4deb-985b-c168165839d9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:16.027643 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01ef4b97-2865-4deb-985b-c168165839d9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:16.088259 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-01ef4b97-2865-4deb-985b-c168165839d9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:16.095956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-01ef4b97-2865-4deb-985b-c168165839d9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1238 microversion: 2.1 time: 0.082767 Aug 18 14:27:16.096504 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 156/308] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:16 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:16.347410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a59fe8c6-ef6c-4758-9f5d-5ad927e0821f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:16.348040 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a59fe8c6-ef6c-4758-9f5d-5ad927e0821f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:16.354122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a59fe8c6-ef6c-4758-9f5d-5ad927e0821f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:16.354604 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a59fe8c6-ef6c-4758-9f5d-5ad927e0821f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:16.355038 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a59fe8c6-ef6c-4758-9f5d-5ad927e0821f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:16.355758 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a59fe8c6-ef6c-4758-9f5d-5ad927e0821f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:16.356208 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a59fe8c6-ef6c-4758-9f5d-5ad927e0821f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:16.356823 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a59fe8c6-ef6c-4758-9f5d-5ad927e0821f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:16.416262 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a59fe8c6-ef6c-4758-9f5d-5ad927e0821f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:16.423780 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a59fe8c6-ef6c-4758-9f5d-5ad927e0821f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1240 microversion: 2.1 time: 0.080523 Aug 18 14:27:16.424345 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 153/309] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:16 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:16.994744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:16.995305 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:17.001505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:17.002126 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:17.002470 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:17.003093 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:17.003573 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:17.004082 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:17.034845 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:17.035319 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:17.035780 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:17.036224 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lazy-loading 'fault' on Instance uuid 663d1c02-1a91-404f-a18c-7dc5fad12b48 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:27:17.080071 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:17.087978 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-47f88067-fcc0-476b-845a-9f1ce2a52e80 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1303 microversion: 2.1 time: 0.097928 Aug 18 14:27:17.088537 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 157/310] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:16 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:17.116923 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0d01956c-ab48-492e-8c69-c1313f66c7ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:17.117592 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0d01956c-ab48-492e-8c69-c1313f66c7ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:17.123931 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d01956c-ab48-492e-8c69-c1313f66c7ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:17.124410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d01956c-ab48-492e-8c69-c1313f66c7ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:17.124843 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d01956c-ab48-492e-8c69-c1313f66c7ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:17.125527 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d01956c-ab48-492e-8c69-c1313f66c7ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:17.125979 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d01956c-ab48-492e-8c69-c1313f66c7ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:17.126401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d01956c-ab48-492e-8c69-c1313f66c7ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:17.186485 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0d01956c-ab48-492e-8c69-c1313f66c7ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:17.194097 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0d01956c-ab48-492e-8c69-c1313f66c7ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1238 microversion: 2.1 time: 0.081548 Aug 18 14:27:17.194667 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 154/311] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:17 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:17.444341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dae720d1-3b45-4dde-97b5-7461a9b394e8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:17.444984 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dae720d1-3b45-4dde-97b5-7461a9b394e8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:17.451255 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dae720d1-3b45-4dde-97b5-7461a9b394e8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:17.451770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dae720d1-3b45-4dde-97b5-7461a9b394e8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:17.452201 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dae720d1-3b45-4dde-97b5-7461a9b394e8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:17.452889 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dae720d1-3b45-4dde-97b5-7461a9b394e8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:17.453337 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dae720d1-3b45-4dde-97b5-7461a9b394e8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:17.453759 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dae720d1-3b45-4dde-97b5-7461a9b394e8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:17.515996 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dae720d1-3b45-4dde-97b5-7461a9b394e8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:17.524149 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dae720d1-3b45-4dde-97b5-7461a9b394e8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1240 microversion: 2.1 time: 0.083689 Aug 18 14:27:17.524715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 158/312] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:17 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:18.108664 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:18.109570 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:18.116867 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:18.118819 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:18.119414 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:18.119984 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:18.120612 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:18.121344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:18.170631 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:18.171124 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:18.171596 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:18.172045 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lazy-loading 'fault' on Instance uuid 663d1c02-1a91-404f-a18c-7dc5fad12b48 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:27:18.213327 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '278dd42fb0264c44b7926fb9d1ff46c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c8f3970f01483b84fce0859a219c84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:18.214866 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8e96bcf4-d01c-4cce-9112-6bda7b4a8250 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:18.215533 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8e96bcf4-d01c-4cce-9112-6bda7b4a8250 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:18.221896 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e96bcf4-d01c-4cce-9112-6bda7b4a8250 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:18.222105 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7696a39a-446e-4f2a-b14a-958f7dcbbad2 tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 200 len: 1303 microversion: 2.1 time: 0.117537 Aug 18 14:27:18.222520 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e96bcf4-d01c-4cce-9112-6bda7b4a8250 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:18.223188 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e96bcf4-d01c-4cce-9112-6bda7b4a8250 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:18.223443 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 155/313] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:18 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:27:18.224005 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e96bcf4-d01c-4cce-9112-6bda7b4a8250 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:18.224467 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e96bcf4-d01c-4cce-9112-6bda7b4a8250 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:18.224896 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e96bcf4-d01c-4cce-9112-6bda7b4a8250 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:18.292112 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8e96bcf4-d01c-4cce-9112-6bda7b4a8250 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:18.300510 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8e96bcf4-d01c-4cce-9112-6bda7b4a8250 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1300 microversion: 2.1 time: 0.090010 Aug 18 14:27:18.301071 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 159/314] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:18 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:27:18.547273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-22d2744a-7ab9-4af7-a868-08aa6a155ea0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:18.548011 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-22d2744a-7ab9-4af7-a868-08aa6a155ea0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:18.555267 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22d2744a-7ab9-4af7-a868-08aa6a155ea0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:18.555983 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22d2744a-7ab9-4af7-a868-08aa6a155ea0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:18.556586 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22d2744a-7ab9-4af7-a868-08aa6a155ea0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:18.557594 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22d2744a-7ab9-4af7-a868-08aa6a155ea0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:18.558201 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22d2744a-7ab9-4af7-a868-08aa6a155ea0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:18.558779 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22d2744a-7ab9-4af7-a868-08aa6a155ea0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:18.662342 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-22d2744a-7ab9-4af7-a868-08aa6a155ea0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:18.672310 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-22d2744a-7ab9-4af7-a868-08aa6a155ea0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1304 microversion: 2.1 time: 0.130163 Aug 18 14:27:18.674237 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 156/315] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:18 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:19.242810 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8bcedde0-39fb-4134-917b-2a20609cc0ca tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:19.243703 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8bcedde0-39fb-4134-917b-2a20609cc0ca tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] [instance: 663d1c02-1a91-404f-a18c-7dc5fad12b48] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:19.256286 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bcedde0-39fb-4134-917b-2a20609cc0ca tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:19.256286 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bcedde0-39fb-4134-917b-2a20609cc0ca tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:19.256286 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bcedde0-39fb-4134-917b-2a20609cc0ca tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:19.256286 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bcedde0-39fb-4134-917b-2a20609cc0ca tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:19.256608 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bcedde0-39fb-4134-917b-2a20609cc0ca tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:19.256608 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bcedde0-39fb-4134-917b-2a20609cc0ca tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:19.273311 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-8bcedde0-39fb-4134-917b-2a20609cc0ca tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] HTTP exception thrown: Instance 663d1c02-1a91-404f-a18c-7dc5fad12b48 could not be found. Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8bcedde0-39fb-4134-917b-2a20609cc0ca tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Request method failure captured: Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 HTTP/1.1 Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kwJNr70HoNs6WoU5pg3U3w6l-fwgwap_OOxfurobed_Z-c82hzV2MVXlHb67BRqhmd27pCkNTX0umxWitBHnXlKj-3brtR3kzYY5ZdxyFJhwTcynMXUSFUYCC7dBOcIFDRJ_w7zTy2qSHI8Ykyq-ffS5E_SyRHeZkYJANmf0DjGdto Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: a8c8f3970f01483b84fce0859a219c84 Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesActionsTest-316541229 Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:27:19.275036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:27:19.276687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a8c8f3970f01483b84fce0859a219c84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a8c8f3970f01483b84fce0859a219c84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a8c8f3970f01483b84fce0859a219c84"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a8c8f3970f01483b84fce0859a219c84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:27:19.276687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesActionsTest-316541229 Aug 18 14:27:19.276687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: a8c8f3970f01483b84fce0859a219c84 Aug 18 14:27:19.276687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesActionsTest-316541229 Aug 18 14:27:19.276687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesActionsTest-316541229-project Aug 18 14:27:19.276687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:27:19.276687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:27:19.276687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 278dd42fb0264c44b7926fb9d1ff46c0 Aug 18 14:27:19.276687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesActionsTest-316541229-project Aug 18 14:27:19.276687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:27:19.276687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 663d1c02-1a91-404f-a18c-7dc5fad12b48 could not be found. Aug 18 14:27:19.276687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '663d1c02-1a91-404f-a18c-7dc5fad12b48'} Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 663d1c02-1a91-404f-a18c-7dc5fad12b48 could not be found. Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:27:19.277936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 663d1c02-1a91-404f-a18c-7dc5fad12b48 could not be found. Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 663d1c02-1a91-404f-a18c-7dc5fad12b48 could not be found. Aug 18 14:27:19.279505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:27:19.280766 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8bcedde0-39fb-4134-917b-2a20609cc0ca tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] Returning 404 to user: Instance 663d1c02-1a91-404f-a18c-7dc5fad12b48 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:27:19.280766 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8bcedde0-39fb-4134-917b-2a20609cc0ca tempest-VolumesActionsTest-316541229 tempest-VolumesActionsTest-316541229-project] 10.222.0.39 "GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48" status: 404 len: 111 microversion: 2.1 time: 0.037830 Aug 18 14:27:19.284340 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 160/316] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:19 2022] GET /compute/v2.1/servers/663d1c02-1a91-404f-a18c-7dc5fad12b48 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:27:19.325338 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-57a54940-1f57-4e2e-8c82-39c52b819c2d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:19.326698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-57a54940-1f57-4e2e-8c82-39c52b819c2d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:19.346250 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57a54940-1f57-4e2e-8c82-39c52b819c2d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:19.346856 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57a54940-1f57-4e2e-8c82-39c52b819c2d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:19.347440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57a54940-1f57-4e2e-8c82-39c52b819c2d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:19.348371 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57a54940-1f57-4e2e-8c82-39c52b819c2d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:19.352043 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57a54940-1f57-4e2e-8c82-39c52b819c2d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:19.352755 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57a54940-1f57-4e2e-8c82-39c52b819c2d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:19.685929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-57a54940-1f57-4e2e-8c82-39c52b819c2d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:19.696288 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-57a54940-1f57-4e2e-8c82-39c52b819c2d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1368 microversion: 2.1 time: 0.376346 Aug 18 14:27:19.699006 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1f3fa883-e8be-4584-ba2b-74858920c51b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:19.699723 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1f3fa883-e8be-4584-ba2b-74858920c51b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:19.703848 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 157/317] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:19 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1368 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:19.715418 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f3fa883-e8be-4584-ba2b-74858920c51b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:19.716951 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f3fa883-e8be-4584-ba2b-74858920c51b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:19.727554 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f3fa883-e8be-4584-ba2b-74858920c51b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:19.728479 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f3fa883-e8be-4584-ba2b-74858920c51b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:19.728977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f3fa883-e8be-4584-ba2b-74858920c51b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:19.729423 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f3fa883-e8be-4584-ba2b-74858920c51b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:19.951287 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1f3fa883-e8be-4584-ba2b-74858920c51b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:19.959107 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1f3fa883-e8be-4584-ba2b-74858920c51b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1367 microversion: 2.1 time: 0.267471 Aug 18 14:27:19.959704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 161/318] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:19 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:20.085913 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-84998752-25f0-42d1-babb-90d918ff6266 req-12023f75-15b2-4e0a-925b-8395a6ab87d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7926083-e26a-4fa9-bd23-73d13c892da4", "tag": "68644b48-fcf3-4a55-b0f0-c2ff0a586bd6"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:20.097837 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-84998752-25f0-42d1-babb-90d918ff6266 req-12023f75-15b2-4e0a-925b-8395a6ab87d8 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:20.098569 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-84998752-25f0-42d1-babb-90d918ff6266 req-12023f75-15b2-4e0a-925b-8395a6ab87d8 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:20.101224 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-84998752-25f0-42d1-babb-90d918ff6266 req-12023f75-15b2-4e0a-925b-8395a6ab87d8 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:20.114188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-84998752-25f0-42d1-babb-90d918ff6266 req-12023f75-15b2-4e0a-925b-8395a6ab87d8 service nova] Creating event network-changed:68644b48-fcf3-4a55-b0f0-c2ff0a586bd6 for instance b7926083-e26a-4fa9-bd23-73d13c892da4 on hv-cinder-85220 Aug 18 14:27:20.124179 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-84998752-25f0-42d1-babb-90d918ff6266 req-12023f75-15b2-4e0a-925b-8395a6ab87d8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047771 Aug 18 14:27:20.125599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 158/319] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:27:20.430670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-bead03f1-59f6-4624-b9a4-1ddca477b2f3 req-1f838cb5-cb06-44ea-adee-5699f8294c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e4b5fa-03a1-40fd-b4e4-89152f368dc9", "tag": "6d2988cf-cd5b-4622-b500-36ce6cdb77ca"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:20.452447 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-bead03f1-59f6-4624-b9a4-1ddca477b2f3 req-1f838cb5-cb06-44ea-adee-5699f8294c8d service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:20.453123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-bead03f1-59f6-4624-b9a4-1ddca477b2f3 req-1f838cb5-cb06-44ea-adee-5699f8294c8d service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:20.453707 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-bead03f1-59f6-4624-b9a4-1ddca477b2f3 req-1f838cb5-cb06-44ea-adee-5699f8294c8d service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:20.467058 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-bead03f1-59f6-4624-b9a4-1ddca477b2f3 req-1f838cb5-cb06-44ea-adee-5699f8294c8d service nova] Creating event network-changed:6d2988cf-cd5b-4622-b500-36ce6cdb77ca for instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 on hv-cinder-85220 Aug 18 14:27:20.472636 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-bead03f1-59f6-4624-b9a4-1ddca477b2f3 req-1f838cb5-cb06-44ea-adee-5699f8294c8d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045925 Aug 18 14:27:20.473708 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 162/320] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:27:20.726467 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ef7d54b2-9eb3-4be6-8311-a5aa6b942429 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:20.727037 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ef7d54b2-9eb3-4be6-8311-a5aa6b942429 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:20.733259 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef7d54b2-9eb3-4be6-8311-a5aa6b942429 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:20.733746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef7d54b2-9eb3-4be6-8311-a5aa6b942429 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:20.734193 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef7d54b2-9eb3-4be6-8311-a5aa6b942429 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:20.734876 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef7d54b2-9eb3-4be6-8311-a5aa6b942429 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:20.735451 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef7d54b2-9eb3-4be6-8311-a5aa6b942429 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:20.735913 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef7d54b2-9eb3-4be6-8311-a5aa6b942429 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:20.904969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ef7d54b2-9eb3-4be6-8311-a5aa6b942429 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:20.913612 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ef7d54b2-9eb3-4be6-8311-a5aa6b942429 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1368 microversion: 2.1 time: 0.191820 Aug 18 14:27:20.914714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 159/321] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:20 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:20.982866 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-baf7c16e-7811-4150-b57c-23e7db89e4ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:20.983601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-baf7c16e-7811-4150-b57c-23e7db89e4ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:20.989750 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-baf7c16e-7811-4150-b57c-23e7db89e4ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:20.990231 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-baf7c16e-7811-4150-b57c-23e7db89e4ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:20.990676 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-baf7c16e-7811-4150-b57c-23e7db89e4ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:20.995940 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-baf7c16e-7811-4150-b57c-23e7db89e4ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:20.996523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-baf7c16e-7811-4150-b57c-23e7db89e4ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:20.997197 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-baf7c16e-7811-4150-b57c-23e7db89e4ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:21.200227 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-baf7c16e-7811-4150-b57c-23e7db89e4ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:21.208540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-baf7c16e-7811-4150-b57c-23e7db89e4ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1367 microversion: 2.1 time: 0.229910 Aug 18 14:27:21.209251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 163/322] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:20 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:27:21.934904 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-01ab0e95-15f6-443b-b197-e0bf97f00549 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:21.935550 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-01ab0e95-15f6-443b-b197-e0bf97f00549 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:21.941702 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01ab0e95-15f6-443b-b197-e0bf97f00549 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:21.942182 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01ab0e95-15f6-443b-b197-e0bf97f00549 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:21.942617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01ab0e95-15f6-443b-b197-e0bf97f00549 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:21.943302 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01ab0e95-15f6-443b-b197-e0bf97f00549 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:21.943885 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01ab0e95-15f6-443b-b197-e0bf97f00549 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:21.945223 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01ab0e95-15f6-443b-b197-e0bf97f00549 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:22.082083 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-01ab0e95-15f6-443b-b197-e0bf97f00549 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:22.090674 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-01ab0e95-15f6-443b-b197-e0bf97f00549 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1368 microversion: 2.1 time: 0.159340 Aug 18 14:27:22.091283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 160/323] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:21 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:22.232243 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4d0b691b-8be7-4bbc-b97b-bc9f67d14ff2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:22.233355 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4d0b691b-8be7-4bbc-b97b-bc9f67d14ff2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:22.245174 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d0b691b-8be7-4bbc-b97b-bc9f67d14ff2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:22.245846 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d0b691b-8be7-4bbc-b97b-bc9f67d14ff2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:22.246343 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d0b691b-8be7-4bbc-b97b-bc9f67d14ff2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:22.247526 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d0b691b-8be7-4bbc-b97b-bc9f67d14ff2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:22.248110 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d0b691b-8be7-4bbc-b97b-bc9f67d14ff2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:22.248596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d0b691b-8be7-4bbc-b97b-bc9f67d14ff2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:22.406155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4d0b691b-8be7-4bbc-b97b-bc9f67d14ff2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:22.414387 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4d0b691b-8be7-4bbc-b97b-bc9f67d14ff2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1367 microversion: 2.1 time: 0.187630 Aug 18 14:27:22.414969 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 164/324] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:22 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:23.113475 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-37838df1-b91e-43fd-a573-732d740d5164 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:23.113995 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-37838df1-b91e-43fd-a573-732d740d5164 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:23.120893 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37838df1-b91e-43fd-a573-732d740d5164 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:23.121372 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37838df1-b91e-43fd-a573-732d740d5164 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:23.121803 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37838df1-b91e-43fd-a573-732d740d5164 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:23.122496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37838df1-b91e-43fd-a573-732d740d5164 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:23.122942 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37838df1-b91e-43fd-a573-732d740d5164 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:23.123361 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37838df1-b91e-43fd-a573-732d740d5164 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:23.261003 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-37838df1-b91e-43fd-a573-732d740d5164 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:23.269934 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-37838df1-b91e-43fd-a573-732d740d5164 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1368 microversion: 2.1 time: 0.160165 Aug 18 14:27:23.271300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 161/325] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:23 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:23.436410 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-230edb26-efe1-4a6c-9bc1-24fdc8e22b5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:23.437029 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-230edb26-efe1-4a6c-9bc1-24fdc8e22b5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:23.442972 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-230edb26-efe1-4a6c-9bc1-24fdc8e22b5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:23.443443 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-230edb26-efe1-4a6c-9bc1-24fdc8e22b5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:23.444087 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-230edb26-efe1-4a6c-9bc1-24fdc8e22b5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:23.444959 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-230edb26-efe1-4a6c-9bc1-24fdc8e22b5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:23.445418 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-230edb26-efe1-4a6c-9bc1-24fdc8e22b5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:23.445848 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-230edb26-efe1-4a6c-9bc1-24fdc8e22b5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:23.665200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-230edb26-efe1-4a6c-9bc1-24fdc8e22b5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:23.672988 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-230edb26-efe1-4a6c-9bc1-24fdc8e22b5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1367 microversion: 2.1 time: 0.241025 Aug 18 14:27:23.673552 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 165/326] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:23 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:27:24.293830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4551c143-6feb-4ed7-acbb-a0b64c275c05 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:24.294451 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4551c143-6feb-4ed7-acbb-a0b64c275c05 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:24.305305 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=4 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:24.306462 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=16 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:24.312435 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4551c143-6feb-4ed7-acbb-a0b64c275c05 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:24.315987 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4551c143-6feb-4ed7-acbb-a0b64c275c05 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:24.316623 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4551c143-6feb-4ed7-acbb-a0b64c275c05 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:24.317546 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4551c143-6feb-4ed7-acbb-a0b64c275c05 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:24.318007 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4551c143-6feb-4ed7-acbb-a0b64c275c05 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:24.318430 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4551c143-6feb-4ed7-acbb-a0b64c275c05 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:24.387096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:24.642621 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4551c143-6feb-4ed7-acbb-a0b64c275c05 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:24.673598 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4551c143-6feb-4ed7-acbb-a0b64c275c05 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1368 microversion: 2.1 time: 0.381013 Aug 18 14:27:24.674630 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 162/327] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:24 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1368 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:24.696590 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0527fe63-ad10-498c-9912-ebda61707b81 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:24.698389 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0527fe63-ad10-498c-9912-ebda61707b81 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:24.705650 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=8 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:24.710421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0527fe63-ad10-498c-9912-ebda61707b81 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:24.711451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0527fe63-ad10-498c-9912-ebda61707b81 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:24.712894 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0527fe63-ad10-498c-9912-ebda61707b81 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:24.713838 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0527fe63-ad10-498c-9912-ebda61707b81 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:24.714366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0527fe63-ad10-498c-9912-ebda61707b81 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:24.715078 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0527fe63-ad10-498c-9912-ebda61707b81 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:24.921393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0527fe63-ad10-498c-9912-ebda61707b81 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:24.929729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0527fe63-ad10-498c-9912-ebda61707b81 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1367 microversion: 2.1 time: 0.238921 Aug 18 14:27:24.930521 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 166/328] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:24 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:25.709631 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3651ca8c-dbda-4fc0-ac7a-997fd833dd50 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:25.711985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3651ca8c-dbda-4fc0-ac7a-997fd833dd50 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:25.720583 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3651ca8c-dbda-4fc0-ac7a-997fd833dd50 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:25.721366 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3651ca8c-dbda-4fc0-ac7a-997fd833dd50 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:25.722010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3651ca8c-dbda-4fc0-ac7a-997fd833dd50 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:25.722919 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3651ca8c-dbda-4fc0-ac7a-997fd833dd50 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:25.723598 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3651ca8c-dbda-4fc0-ac7a-997fd833dd50 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:25.724368 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3651ca8c-dbda-4fc0-ac7a-997fd833dd50 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:25.952429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-62367755-0b9c-488f-9aad-03f4f6e068cf tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:25.953847 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-62367755-0b9c-488f-9aad-03f4f6e068cf tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:25.972522 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62367755-0b9c-488f-9aad-03f4f6e068cf tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:25.974602 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62367755-0b9c-488f-9aad-03f4f6e068cf tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:25.975348 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62367755-0b9c-488f-9aad-03f4f6e068cf tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:25.976711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62367755-0b9c-488f-9aad-03f4f6e068cf tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:25.979166 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62367755-0b9c-488f-9aad-03f4f6e068cf tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:25.980941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62367755-0b9c-488f-9aad-03f4f6e068cf tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:26.439394 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3651ca8c-dbda-4fc0-ac7a-997fd833dd50 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:26.452323 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3651ca8c-dbda-4fc0-ac7a-997fd833dd50 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1368 microversion: 2.1 time: 0.758531 Aug 18 14:27:26.452931 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 163/329] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:25 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1368 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:26.466715 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-392313454", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "networks": [{"uuid": "c714e51c-eb2a-4d87-9390-e0cd68593e4c"}]}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:26.543879 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] validate_networks() for [('c714e51c-eb2a-4d87-9390-e0cd68593e4c', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:27:26.547711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-62367755-0b9c-488f-9aad-03f4f6e068cf tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:26.561719 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-62367755-0b9c-488f-9aad-03f4f6e068cf tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1367 microversion: 2.1 time: 0.609631 Aug 18 14:27:26.576071 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 167/330] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:25 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1367 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:27.082431 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:27:27.083515 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:27:27.084165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:27:27.085126 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:27:27.085545 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:27:27.099443 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:27.099960 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:27.101003 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:27.101741 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:27.102198 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:27.102622 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:27.121249 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Getting quotas for project 4d1de27922464f9291f0999378307c06. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:27:27.125501 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:27.127479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Getting quotas for user 677239d934c04e50b024a001c0152e57 and project 4d1de27922464f9291f0999378307c06. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:27:27.148251 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:27:27.151578 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:27:27.219888 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1260e227-5af0-4c24-bf89-c034d7070b41 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762291 Aug 18 14:27:27.230373 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 164/331] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:27:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:27:27.235927 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4652f07e-f97c-4da1-ade4-f427ced569f0 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:27.238269 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4652f07e-f97c-4da1-ade4-f427ced569f0 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:27.322868 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4652f07e-f97c-4da1-ade4-f427ced569f0 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:27.334292 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4652f07e-f97c-4da1-ade4-f427ced569f0 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1218 microversion: 2.1 time: 0.103090 Aug 18 14:27:27.337241 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 168/332] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:27 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:27:27.478130 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fa37fccc-f203-4085-a5c5-37462be7ef91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:27.479387 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fa37fccc-f203-4085-a5c5-37462be7ef91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:27.492761 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa37fccc-f203-4085-a5c5-37462be7ef91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:27.500087 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa37fccc-f203-4085-a5c5-37462be7ef91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:27.502273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa37fccc-f203-4085-a5c5-37462be7ef91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:27.504718 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa37fccc-f203-4085-a5c5-37462be7ef91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:27.507144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa37fccc-f203-4085-a5c5-37462be7ef91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:27.509286 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa37fccc-f203-4085-a5c5-37462be7ef91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:27.589389 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-30068ec0-180f-41f4-a350-9df8c15f515f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:27.590304 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-30068ec0-180f-41f4-a350-9df8c15f515f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:27.605297 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30068ec0-180f-41f4-a350-9df8c15f515f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:27.610471 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30068ec0-180f-41f4-a350-9df8c15f515f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:27.611188 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30068ec0-180f-41f4-a350-9df8c15f515f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:27.612802 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30068ec0-180f-41f4-a350-9df8c15f515f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:27.614627 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30068ec0-180f-41f4-a350-9df8c15f515f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:27.619610 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30068ec0-180f-41f4-a350-9df8c15f515f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:27.723467 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fa37fccc-f203-4085-a5c5-37462be7ef91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:27.733569 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fa37fccc-f203-4085-a5c5-37462be7ef91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1368 microversion: 2.1 time: 0.261158 Aug 18 14:27:27.734529 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 165/333] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:27 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:27:27.900279 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-30068ec0-180f-41f4-a350-9df8c15f515f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:27.908655 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-30068ec0-180f-41f4-a350-9df8c15f515f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1367 microversion: 2.1 time: 0.325747 Aug 18 14:27:27.909232 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 169/334] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:27 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:27:28.358230 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f3e74682-6fb4-456b-9dd6-068a9848176f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:28.358864 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f3e74682-6fb4-456b-9dd6-068a9848176f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:28.365675 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3e74682-6fb4-456b-9dd6-068a9848176f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:28.366169 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3e74682-6fb4-456b-9dd6-068a9848176f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:28.366606 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3e74682-6fb4-456b-9dd6-068a9848176f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:28.367310 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3e74682-6fb4-456b-9dd6-068a9848176f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:28.367794 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3e74682-6fb4-456b-9dd6-068a9848176f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:28.368233 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3e74682-6fb4-456b-9dd6-068a9848176f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:28.513013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f3e74682-6fb4-456b-9dd6-068a9848176f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:28.550298 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f3e74682-6fb4-456b-9dd6-068a9848176f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1270 microversion: 2.1 time: 0.194504 Aug 18 14:27:28.553978 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 166/335] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:28 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1270 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:28.755638 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5ee64d51-cbaa-48ce-b3fe-89fbd314ffa6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:28.756585 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5ee64d51-cbaa-48ce-b3fe-89fbd314ffa6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:28.765739 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-8fd199f7-98a4-4b19-bba8-9f4e405bb58c req-0b58c369-7916-4240-8166-b259fd11f2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7926083-e26a-4fa9-bd23-73d13c892da4", "name": "network-vif-plugged", "status": "completed", "tag": "68644b48-fcf3-4a55-b0f0-c2ff0a586bd6"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:28.785038 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ee64d51-cbaa-48ce-b3fe-89fbd314ffa6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:28.789643 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ee64d51-cbaa-48ce-b3fe-89fbd314ffa6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:28.791540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ee64d51-cbaa-48ce-b3fe-89fbd314ffa6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:28.794473 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ee64d51-cbaa-48ce-b3fe-89fbd314ffa6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:28.797373 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ee64d51-cbaa-48ce-b3fe-89fbd314ffa6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:28.798457 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ee64d51-cbaa-48ce-b3fe-89fbd314ffa6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:28.798665 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-8fd199f7-98a4-4b19-bba8-9f4e405bb58c req-0b58c369-7916-4240-8166-b259fd11f2b9 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:28.801573 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-8fd199f7-98a4-4b19-bba8-9f4e405bb58c req-0b58c369-7916-4240-8166-b259fd11f2b9 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:28.802328 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-8fd199f7-98a4-4b19-bba8-9f4e405bb58c req-0b58c369-7916-4240-8166-b259fd11f2b9 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:28.844942 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-8fd199f7-98a4-4b19-bba8-9f4e405bb58c req-0b58c369-7916-4240-8166-b259fd11f2b9 service nova] Creating event network-vif-plugged:68644b48-fcf3-4a55-b0f0-c2ff0a586bd6 for instance b7926083-e26a-4fa9-bd23-73d13c892da4 on hv-cinder-85220 Aug 18 14:27:28.862293 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-8fd199f7-98a4-4b19-bba8-9f4e405bb58c req-0b58c369-7916-4240-8166-b259fd11f2b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099783 Aug 18 14:27:28.863622 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 167/336] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:27:28.952053 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6b1c6caf-f675-4dc2-a32e-71cdef147b38 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:28.956247 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6b1c6caf-f675-4dc2-a32e-71cdef147b38 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:28.982711 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b1c6caf-f675-4dc2-a32e-71cdef147b38 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:28.983226 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b1c6caf-f675-4dc2-a32e-71cdef147b38 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:28.985426 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b1c6caf-f675-4dc2-a32e-71cdef147b38 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:28.987956 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b1c6caf-f675-4dc2-a32e-71cdef147b38 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:28.988451 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b1c6caf-f675-4dc2-a32e-71cdef147b38 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:28.988957 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b1c6caf-f675-4dc2-a32e-71cdef147b38 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:29.376833 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5ee64d51-cbaa-48ce-b3fe-89fbd314ffa6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:29.390124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5ee64d51-cbaa-48ce-b3fe-89fbd314ffa6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1368 microversion: 2.1 time: 0.638421 Aug 18 14:27:29.393666 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 170/337] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:28 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1368 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:29.395239 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6b1c6caf-f675-4dc2-a32e-71cdef147b38 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:29.405112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6b1c6caf-f675-4dc2-a32e-71cdef147b38 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1367 microversion: 2.1 time: 0.472323 Aug 18 14:27:29.423212 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 168/338] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:28 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1367 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:27:29.576180 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e7987c07-e629-4cdb-83fb-337488a441cb tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:29.577089 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e7987c07-e629-4cdb-83fb-337488a441cb tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:29.583435 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7987c07-e629-4cdb-83fb-337488a441cb tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:29.584150 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7987c07-e629-4cdb-83fb-337488a441cb tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:29.584794 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7987c07-e629-4cdb-83fb-337488a441cb tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:29.585722 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7987c07-e629-4cdb-83fb-337488a441cb tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:29.586198 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7987c07-e629-4cdb-83fb-337488a441cb tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:29.586641 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7987c07-e629-4cdb-83fb-337488a441cb tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:29.683829 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e7987c07-e629-4cdb-83fb-337488a441cb tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:29.688595 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:29.699693 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e7987c07-e629-4cdb-83fb-337488a441cb tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1276 microversion: 2.1 time: 0.127129 Aug 18 14:27:29.702667 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 171/339] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:29 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1276 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:30.413845 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7f196ede-426b-4648-a0c8-7be71e69965b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:30.416580 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7f196ede-426b-4648-a0c8-7be71e69965b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:30.424690 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f196ede-426b-4648-a0c8-7be71e69965b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:30.425282 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f196ede-426b-4648-a0c8-7be71e69965b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:30.425934 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f196ede-426b-4648-a0c8-7be71e69965b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:30.426662 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f196ede-426b-4648-a0c8-7be71e69965b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:30.426818 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c8131ae8-ee9a-41f9-8951-36daa0ea46fe tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:30.427329 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f196ede-426b-4648-a0c8-7be71e69965b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:30.427570 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f196ede-426b-4648-a0c8-7be71e69965b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:30.428273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c8131ae8-ee9a-41f9-8951-36daa0ea46fe tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:30.440994 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8131ae8-ee9a-41f9-8951-36daa0ea46fe tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:30.441816 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8131ae8-ee9a-41f9-8951-36daa0ea46fe tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:30.442513 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8131ae8-ee9a-41f9-8951-36daa0ea46fe tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:30.443291 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8131ae8-ee9a-41f9-8951-36daa0ea46fe tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:30.444387 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8131ae8-ee9a-41f9-8951-36daa0ea46fe tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:30.445057 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8131ae8-ee9a-41f9-8951-36daa0ea46fe tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:30.610852 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7f196ede-426b-4648-a0c8-7be71e69965b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:30.624978 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7f196ede-426b-4648-a0c8-7be71e69965b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1368 microversion: 2.1 time: 0.215720 Aug 18 14:27:30.635458 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 169/340] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:30 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:30.651131 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c8131ae8-ee9a-41f9-8951-36daa0ea46fe tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:30.659776 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c8131ae8-ee9a-41f9-8951-36daa0ea46fe tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1367 microversion: 2.1 time: 0.237452 Aug 18 14:27:30.661853 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 172/341] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:30 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:30.722376 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-00e06eda-bec4-4776-b77b-e9208c59e4bf tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:30.723728 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-00e06eda-bec4-4776-b77b-e9208c59e4bf tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:30.733996 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00e06eda-bec4-4776-b77b-e9208c59e4bf tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:30.735002 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00e06eda-bec4-4776-b77b-e9208c59e4bf tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:30.735752 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00e06eda-bec4-4776-b77b-e9208c59e4bf tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:30.737036 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00e06eda-bec4-4776-b77b-e9208c59e4bf tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:30.737885 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00e06eda-bec4-4776-b77b-e9208c59e4bf tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:30.738477 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00e06eda-bec4-4776-b77b-e9208c59e4bf tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:30.914580 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-00e06eda-bec4-4776-b77b-e9208c59e4bf tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:30.922794 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-00e06eda-bec4-4776-b77b-e9208c59e4bf tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1318 microversion: 2.1 time: 0.205586 Aug 18 14:27:30.923668 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 170/342] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:30 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:31.660826 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-af9c2429-1016-4d67-a12b-f3283262ceb8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:31.663570 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-af9c2429-1016-4d67-a12b-f3283262ceb8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:31.671545 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af9c2429-1016-4d67-a12b-f3283262ceb8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:31.672585 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af9c2429-1016-4d67-a12b-f3283262ceb8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:31.673528 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af9c2429-1016-4d67-a12b-f3283262ceb8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:31.674577 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af9c2429-1016-4d67-a12b-f3283262ceb8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:31.675141 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af9c2429-1016-4d67-a12b-f3283262ceb8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:31.675663 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af9c2429-1016-4d67-a12b-f3283262ceb8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:31.688771 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2b6e2fd4-1faa-4a4d-9b12-4125e034a609 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:31.690389 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2b6e2fd4-1faa-4a4d-9b12-4125e034a609 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:31.697509 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b6e2fd4-1faa-4a4d-9b12-4125e034a609 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:31.698687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b6e2fd4-1faa-4a4d-9b12-4125e034a609 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:31.699390 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b6e2fd4-1faa-4a4d-9b12-4125e034a609 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:31.700383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b6e2fd4-1faa-4a4d-9b12-4125e034a609 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:31.701087 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b6e2fd4-1faa-4a4d-9b12-4125e034a609 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:31.701743 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b6e2fd4-1faa-4a4d-9b12-4125e034a609 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:31.861598 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-af9c2429-1016-4d67-a12b-f3283262ceb8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:31.866352 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2b6e2fd4-1faa-4a4d-9b12-4125e034a609 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:31.871215 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-af9c2429-1016-4d67-a12b-f3283262ceb8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1368 microversion: 2.1 time: 0.217207 Aug 18 14:27:31.879432 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 173/343] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:31 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:31.885347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2b6e2fd4-1faa-4a4d-9b12-4125e034a609 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1367 microversion: 2.1 time: 0.200694 Aug 18 14:27:31.887407 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 171/344] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:31 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:31.947115 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-94eb45e3-e58f-4580-bdde-d82002368e1d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:31.947682 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-94eb45e3-e58f-4580-bdde-d82002368e1d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:31.954175 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94eb45e3-e58f-4580-bdde-d82002368e1d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:31.954670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94eb45e3-e58f-4580-bdde-d82002368e1d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:31.955109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94eb45e3-e58f-4580-bdde-d82002368e1d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:31.955851 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94eb45e3-e58f-4580-bdde-d82002368e1d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:31.956304 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94eb45e3-e58f-4580-bdde-d82002368e1d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:31.956727 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94eb45e3-e58f-4580-bdde-d82002368e1d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:32.104972 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-94eb45e3-e58f-4580-bdde-d82002368e1d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:32.123107 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-94eb45e3-e58f-4580-bdde-d82002368e1d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1318 microversion: 2.1 time: 0.180013 Aug 18 14:27:32.136493 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 174/345] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:31 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:32.893734 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9f52edd4-e44c-4628-b09e-4a039ca9ccc0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:32.895267 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9f52edd4-e44c-4628-b09e-4a039ca9ccc0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:32.906758 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5f389dc5-f4c5-42a6-9747-6e536663c7cb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:32.907382 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5f389dc5-f4c5-42a6-9747-6e536663c7cb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:32.918697 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f389dc5-f4c5-42a6-9747-6e536663c7cb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:32.921342 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f389dc5-f4c5-42a6-9747-6e536663c7cb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:32.921856 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f389dc5-f4c5-42a6-9747-6e536663c7cb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:32.924489 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f389dc5-f4c5-42a6-9747-6e536663c7cb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:32.925018 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f389dc5-f4c5-42a6-9747-6e536663c7cb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:32.926165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f389dc5-f4c5-42a6-9747-6e536663c7cb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:32.930154 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f52edd4-e44c-4628-b09e-4a039ca9ccc0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:32.930660 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f52edd4-e44c-4628-b09e-4a039ca9ccc0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:32.931112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f52edd4-e44c-4628-b09e-4a039ca9ccc0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:32.931881 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f52edd4-e44c-4628-b09e-4a039ca9ccc0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:32.932329 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f52edd4-e44c-4628-b09e-4a039ca9ccc0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:32.932755 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f52edd4-e44c-4628-b09e-4a039ca9ccc0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:33.130919 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9f52edd4-e44c-4628-b09e-4a039ca9ccc0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:33.142648 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9f52edd4-e44c-4628-b09e-4a039ca9ccc0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1368 microversion: 2.1 time: 0.253656 Aug 18 14:27:33.144120 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 172/346] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:32 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:33.153263 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-592511d3-8a75-48cb-8619-df581afc6a41 req-24c64013-9d7b-48d0-b028-ddfee80c5770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e4b5fa-03a1-40fd-b4e4-89152f368dc9", "name": "network-vif-plugged", "status": "completed", "tag": "6d2988cf-cd5b-4622-b500-36ce6cdb77ca"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:33.174450 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-592511d3-8a75-48cb-8619-df581afc6a41 req-24c64013-9d7b-48d0-b028-ddfee80c5770 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:33.175245 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-592511d3-8a75-48cb-8619-df581afc6a41 req-24c64013-9d7b-48d0-b028-ddfee80c5770 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:33.175925 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-592511d3-8a75-48cb-8619-df581afc6a41 req-24c64013-9d7b-48d0-b028-ddfee80c5770 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:33.196411 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-592511d3-8a75-48cb-8619-df581afc6a41 req-24c64013-9d7b-48d0-b028-ddfee80c5770 service nova] Creating event network-vif-plugged:6d2988cf-cd5b-4622-b500-36ce6cdb77ca for instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 on hv-cinder-85220 Aug 18 14:27:33.202171 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-592511d3-8a75-48cb-8619-df581afc6a41 req-24c64013-9d7b-48d0-b028-ddfee80c5770 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056405 Aug 18 14:27:33.203051 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 173/347] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:27:33.214780 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d2d42a99-c7a1-457d-808d-e3e08435f795 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:33.216142 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d2d42a99-c7a1-457d-808d-e3e08435f795 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:33.223904 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d2d42a99-c7a1-457d-808d-e3e08435f795 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:33.224927 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d2d42a99-c7a1-457d-808d-e3e08435f795 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:33.226785 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d2d42a99-c7a1-457d-808d-e3e08435f795 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:33.227752 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d2d42a99-c7a1-457d-808d-e3e08435f795 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:33.228423 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d2d42a99-c7a1-457d-808d-e3e08435f795 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:33.229079 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d2d42a99-c7a1-457d-808d-e3e08435f795 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:33.321025 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5f389dc5-f4c5-42a6-9747-6e536663c7cb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:33.332574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5f389dc5-f4c5-42a6-9747-6e536663c7cb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1367 microversion: 2.1 time: 0.429461 Aug 18 14:27:33.333578 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 175/348] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:32 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:33.465182 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d2d42a99-c7a1-457d-808d-e3e08435f795 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:33.477589 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d2d42a99-c7a1-457d-808d-e3e08435f795 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1318 microversion: 2.1 time: 0.273144 Aug 18 14:27:33.478273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 174/349] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:33 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:33.620379 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-54f335df-78df-4792-9a80-b3f4287a82b3 req-6a9a915a-b883-438c-ad4f-01fbdb4a52f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5986cc6-52c8-48ae-8cba-92b60e02d98e", "tag": "2208a5c4-fcbe-421c-ba27-a7c0acca16a3"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:33.641631 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-54f335df-78df-4792-9a80-b3f4287a82b3 req-6a9a915a-b883-438c-ad4f-01fbdb4a52f4 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:33.642407 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-54f335df-78df-4792-9a80-b3f4287a82b3 req-6a9a915a-b883-438c-ad4f-01fbdb4a52f4 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:33.650969 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-54f335df-78df-4792-9a80-b3f4287a82b3 req-6a9a915a-b883-438c-ad4f-01fbdb4a52f4 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:33.665399 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-54f335df-78df-4792-9a80-b3f4287a82b3 req-6a9a915a-b883-438c-ad4f-01fbdb4a52f4 service nova] Creating event network-changed:2208a5c4-fcbe-421c-ba27-a7c0acca16a3 for instance f5986cc6-52c8-48ae-8cba-92b60e02d98e on hv-cinder-85220 Aug 18 14:27:33.671735 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-54f335df-78df-4792-9a80-b3f4287a82b3 req-6a9a915a-b883-438c-ad4f-01fbdb4a52f4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055441 Aug 18 14:27:33.673129 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 176/350] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:27:34.168824 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a3703246-8230-4f88-b5cd-c42594f78f19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:34.169754 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a3703246-8230-4f88-b5cd-c42594f78f19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:34.194792 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3703246-8230-4f88-b5cd-c42594f78f19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:34.195861 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3703246-8230-4f88-b5cd-c42594f78f19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:34.196532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3703246-8230-4f88-b5cd-c42594f78f19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:34.197751 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3703246-8230-4f88-b5cd-c42594f78f19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:34.198423 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3703246-8230-4f88-b5cd-c42594f78f19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:34.199059 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3703246-8230-4f88-b5cd-c42594f78f19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:34.359270 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-913bc045-fd6d-428d-9b0e-17833416239c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:34.360627 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-913bc045-fd6d-428d-9b0e-17833416239c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:34.370457 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-913bc045-fd6d-428d-9b0e-17833416239c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:34.376504 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-913bc045-fd6d-428d-9b0e-17833416239c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:34.380843 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-913bc045-fd6d-428d-9b0e-17833416239c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:34.382513 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-913bc045-fd6d-428d-9b0e-17833416239c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:34.383533 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-913bc045-fd6d-428d-9b0e-17833416239c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:34.384207 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-913bc045-fd6d-428d-9b0e-17833416239c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:34.396774 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a3703246-8230-4f88-b5cd-c42594f78f19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:34.406815 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a3703246-8230-4f88-b5cd-c42594f78f19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1557 microversion: 2.1 time: 0.242360 Aug 18 14:27:34.423933 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 175/351] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:34 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1557 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:34.429932 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0f2f6ec5-e6e5-4a78-a723-9337636a39fe tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:34.430825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0f2f6ec5-e6e5-4a78-a723-9337636a39fe tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:34.438003 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f2f6ec5-e6e5-4a78-a723-9337636a39fe tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:34.438832 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f2f6ec5-e6e5-4a78-a723-9337636a39fe tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:34.439520 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f2f6ec5-e6e5-4a78-a723-9337636a39fe tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:34.440474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f2f6ec5-e6e5-4a78-a723-9337636a39fe tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:34.441134 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f2f6ec5-e6e5-4a78-a723-9337636a39fe tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:34.441769 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f2f6ec5-e6e5-4a78-a723-9337636a39fe tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:34.532818 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0f2f6ec5-e6e5-4a78-a723-9337636a39fe tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107259 Aug 18 14:27:34.533373 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 176/352] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Aug 18 14:27:34 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:27:34.538239 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1818f34b-7ebf-4bcd-a6cc-ee05d7869de4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:34.538853 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1818f34b-7ebf-4bcd-a6cc-ee05d7869de4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:34.548398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1818f34b-7ebf-4bcd-a6cc-ee05d7869de4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:34.548899 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1818f34b-7ebf-4bcd-a6cc-ee05d7869de4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:34.549345 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1818f34b-7ebf-4bcd-a6cc-ee05d7869de4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:34.559275 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1818f34b-7ebf-4bcd-a6cc-ee05d7869de4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:34.560070 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1818f34b-7ebf-4bcd-a6cc-ee05d7869de4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:34.560526 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1818f34b-7ebf-4bcd-a6cc-ee05d7869de4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:34.699914 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-913bc045-fd6d-428d-9b0e-17833416239c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:34.710483 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-913bc045-fd6d-428d-9b0e-17833416239c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1367 microversion: 2.1 time: 0.356590 Aug 18 14:27:34.711061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 177/353] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:34 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:34.845612 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1818f34b-7ebf-4bcd-a6cc-ee05d7869de4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:34.856206 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1818f34b-7ebf-4bcd-a6cc-ee05d7869de4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1318 microversion: 2.1 time: 0.321615 Aug 18 14:27:34.856797 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 177/354] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:34 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:35.751868 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3d6ee346-b185-4283-ad6b-9f71e11b6661 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:35.752495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3d6ee346-b185-4283-ad6b-9f71e11b6661 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:35.773512 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d6ee346-b185-4283-ad6b-9f71e11b6661 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:35.773913 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d6ee346-b185-4283-ad6b-9f71e11b6661 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:35.774350 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d6ee346-b185-4283-ad6b-9f71e11b6661 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:35.777671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d6ee346-b185-4283-ad6b-9f71e11b6661 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:35.779661 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d6ee346-b185-4283-ad6b-9f71e11b6661 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:35.780575 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d6ee346-b185-4283-ad6b-9f71e11b6661 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:35.790072 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-ff8be59f-1967-4dd2-99c7-9b44ac9c3b7e req-8463e53b-65c7-4181-9fb2-ecd203d4561e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7926083-e26a-4fa9-bd23-73d13c892da4", "tag": "68644b48-fcf3-4a55-b0f0-c2ff0a586bd6"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:35.801151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-ff8be59f-1967-4dd2-99c7-9b44ac9c3b7e req-8463e53b-65c7-4181-9fb2-ecd203d4561e service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:35.802049 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-ff8be59f-1967-4dd2-99c7-9b44ac9c3b7e req-8463e53b-65c7-4181-9fb2-ecd203d4561e service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:35.802707 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-ff8be59f-1967-4dd2-99c7-9b44ac9c3b7e req-8463e53b-65c7-4181-9fb2-ecd203d4561e service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:35.822169 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-ff8be59f-1967-4dd2-99c7-9b44ac9c3b7e req-8463e53b-65c7-4181-9fb2-ecd203d4561e service nova] Creating event network-changed:68644b48-fcf3-4a55-b0f0-c2ff0a586bd6 for instance b7926083-e26a-4fa9-bd23-73d13c892da4 on hv-cinder-85220 Aug 18 14:27:35.828801 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-ff8be59f-1967-4dd2-99c7-9b44ac9c3b7e req-8463e53b-65c7-4181-9fb2-ecd203d4561e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044042 Aug 18 14:27:35.830066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 178/355] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:27:35.885713 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1f48216c-ae9f-496a-828f-2223a56d7884 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:35.887423 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1f48216c-ae9f-496a-828f-2223a56d7884 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:35.895537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f48216c-ae9f-496a-828f-2223a56d7884 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:35.896490 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f48216c-ae9f-496a-828f-2223a56d7884 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:35.897970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f48216c-ae9f-496a-828f-2223a56d7884 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:35.901164 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f48216c-ae9f-496a-828f-2223a56d7884 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:35.902687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f48216c-ae9f-496a-828f-2223a56d7884 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:35.903228 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f48216c-ae9f-496a-828f-2223a56d7884 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:36.025354 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3d6ee346-b185-4283-ad6b-9f71e11b6661 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:36.039539 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3d6ee346-b185-4283-ad6b-9f71e11b6661 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1561 microversion: 2.1 time: 0.308214 Aug 18 14:27:36.040916 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 178/356] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:35 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1561 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:36.061799 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9f74e503-d4ca-43ea-9060-0986e99181c2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:36.062308 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9f74e503-d4ca-43ea-9060-0986e99181c2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:36.079947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f74e503-d4ca-43ea-9060-0986e99181c2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:36.080470 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f74e503-d4ca-43ea-9060-0986e99181c2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:36.080923 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f74e503-d4ca-43ea-9060-0986e99181c2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:36.081657 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f74e503-d4ca-43ea-9060-0986e99181c2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:36.082159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f74e503-d4ca-43ea-9060-0986e99181c2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:36.085830 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f74e503-d4ca-43ea-9060-0986e99181c2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:36.131781 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1f48216c-ae9f-496a-828f-2223a56d7884 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:36.146334 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1f48216c-ae9f-496a-828f-2223a56d7884 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1318 microversion: 2.1 time: 0.268379 Aug 18 14:27:36.163992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 179/357] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:35 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:36.255969 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9f74e503-d4ca-43ea-9060-0986e99181c2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.198088 Aug 18 14:27:36.257457 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 179/358] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Aug 18 14:27:36 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:27:37.175079 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-782aad4e-4758-4696-818d-8c0e96466609 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:37.175873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-782aad4e-4758-4696-818d-8c0e96466609 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:37.186087 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:37.188742 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:37.191052 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-782aad4e-4758-4696-818d-8c0e96466609 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:37.196876 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-782aad4e-4758-4696-818d-8c0e96466609 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:37.200696 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-782aad4e-4758-4696-818d-8c0e96466609 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:37.201522 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-782aad4e-4758-4696-818d-8c0e96466609 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:37.202205 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-782aad4e-4758-4696-818d-8c0e96466609 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:37.202849 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-782aad4e-4758-4696-818d-8c0e96466609 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:37.685711 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-782aad4e-4758-4696-818d-8c0e96466609 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:37.696159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-782aad4e-4758-4696-818d-8c0e96466609 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1318 microversion: 2.1 time: 0.524801 Aug 18 14:27:37.698177 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 180/359] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:37 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:38.366166 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-492fde5f-b11d-4fa9-8e54-e5a4e1c4a221 req-8691361a-c193-40d8-9248-acb7917901b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e4b5fa-03a1-40fd-b4e4-89152f368dc9", "tag": "6d2988cf-cd5b-4622-b500-36ce6cdb77ca"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:38.379196 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:38.382370 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-492fde5f-b11d-4fa9-8e54-e5a4e1c4a221 req-8691361a-c193-40d8-9248-acb7917901b7 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:38.383704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-492fde5f-b11d-4fa9-8e54-e5a4e1c4a221 req-8691361a-c193-40d8-9248-acb7917901b7 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:38.384523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-492fde5f-b11d-4fa9-8e54-e5a4e1c4a221 req-8691361a-c193-40d8-9248-acb7917901b7 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:38.405770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-492fde5f-b11d-4fa9-8e54-e5a4e1c4a221 req-8691361a-c193-40d8-9248-acb7917901b7 service nova] Creating event network-changed:6d2988cf-cd5b-4622-b500-36ce6cdb77ca for instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 on hv-cinder-85220 Aug 18 14:27:38.412925 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-492fde5f-b11d-4fa9-8e54-e5a4e1c4a221 req-8691361a-c193-40d8-9248-acb7917901b7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063193 Aug 18 14:27:38.413797 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 180/360] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:27:38.718232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-62db703e-2b21-4ba8-9b54-fc6a47dbd923 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:38.719685 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-62db703e-2b21-4ba8-9b54-fc6a47dbd923 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:38.732602 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62db703e-2b21-4ba8-9b54-fc6a47dbd923 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:38.735694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62db703e-2b21-4ba8-9b54-fc6a47dbd923 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:38.736283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62db703e-2b21-4ba8-9b54-fc6a47dbd923 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:38.737258 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62db703e-2b21-4ba8-9b54-fc6a47dbd923 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:38.738656 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62db703e-2b21-4ba8-9b54-fc6a47dbd923 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:38.740052 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62db703e-2b21-4ba8-9b54-fc6a47dbd923 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:38.921601 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-62db703e-2b21-4ba8-9b54-fc6a47dbd923 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:38.928549 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:38.944925 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-62db703e-2b21-4ba8-9b54-fc6a47dbd923 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1318 microversion: 2.1 time: 0.229554 Aug 18 14:27:38.945934 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 181/361] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:38 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:39.966412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-726b61b9-44a8-4e8c-966e-1e04364b7daa tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:39.967204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-726b61b9-44a8-4e8c-966e-1e04364b7daa tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:39.974727 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-726b61b9-44a8-4e8c-966e-1e04364b7daa tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:39.975796 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-726b61b9-44a8-4e8c-966e-1e04364b7daa tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:39.976232 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-726b61b9-44a8-4e8c-966e-1e04364b7daa tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:39.977002 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-726b61b9-44a8-4e8c-966e-1e04364b7daa tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:39.977457 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-726b61b9-44a8-4e8c-966e-1e04364b7daa tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:39.977905 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-726b61b9-44a8-4e8c-966e-1e04364b7daa tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:40.141809 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-726b61b9-44a8-4e8c-966e-1e04364b7daa tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:40.150224 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-726b61b9-44a8-4e8c-966e-1e04364b7daa tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1318 microversion: 2.1 time: 0.188096 Aug 18 14:27:40.151031 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 181/362] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:39 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:40.909418 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-103492f3-9f9b-4182-b947-2a0f1281e8d3 req-f8a35154-7d2f-4e4c-aa90-fa0f3fd6d16f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5986cc6-52c8-48ae-8cba-92b60e02d98e", "name": "network-vif-plugged", "status": "completed", "tag": "2208a5c4-fcbe-421c-ba27-a7c0acca16a3"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:40.930228 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-103492f3-9f9b-4182-b947-2a0f1281e8d3 req-f8a35154-7d2f-4e4c-aa90-fa0f3fd6d16f service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:40.931753 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-103492f3-9f9b-4182-b947-2a0f1281e8d3 req-f8a35154-7d2f-4e4c-aa90-fa0f3fd6d16f service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:40.932427 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-103492f3-9f9b-4182-b947-2a0f1281e8d3 req-f8a35154-7d2f-4e4c-aa90-fa0f3fd6d16f service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:40.956073 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-103492f3-9f9b-4182-b947-2a0f1281e8d3 req-f8a35154-7d2f-4e4c-aa90-fa0f3fd6d16f service nova] Creating event network-vif-plugged:2208a5c4-fcbe-421c-ba27-a7c0acca16a3 for instance f5986cc6-52c8-48ae-8cba-92b60e02d98e on hv-cinder-85220 Aug 18 14:27:40.962892 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-103492f3-9f9b-4182-b947-2a0f1281e8d3 req-f8a35154-7d2f-4e4c-aa90-fa0f3fd6d16f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061581 Aug 18 14:27:40.963925 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 182/363] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:27:41.175967 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-91f18ae4-95c5-4d6d-84a7-35d8f8f0e6cd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:41.177276 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-91f18ae4-95c5-4d6d-84a7-35d8f8f0e6cd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:41.183314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:41.185869 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91f18ae4-95c5-4d6d-84a7-35d8f8f0e6cd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:41.186511 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91f18ae4-95c5-4d6d-84a7-35d8f8f0e6cd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:41.187202 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91f18ae4-95c5-4d6d-84a7-35d8f8f0e6cd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:41.188289 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91f18ae4-95c5-4d6d-84a7-35d8f8f0e6cd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:41.188830 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91f18ae4-95c5-4d6d-84a7-35d8f8f0e6cd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:41.189327 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91f18ae4-95c5-4d6d-84a7-35d8f8f0e6cd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:41.339046 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-91f18ae4-95c5-4d6d-84a7-35d8f8f0e6cd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:41.351624 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-91f18ae4-95c5-4d6d-84a7-35d8f8f0e6cd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1318 microversion: 2.1 time: 0.180954 Aug 18 14:27:41.352541 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 182/364] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:41 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:42.375350 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e67016db-d5a2-4542-9e41-37d6812a9da6 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:42.376089 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e67016db-d5a2-4542-9e41-37d6812a9da6 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:42.385211 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e67016db-d5a2-4542-9e41-37d6812a9da6 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:42.385713 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e67016db-d5a2-4542-9e41-37d6812a9da6 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:42.386148 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e67016db-d5a2-4542-9e41-37d6812a9da6 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:42.386852 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e67016db-d5a2-4542-9e41-37d6812a9da6 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:42.387307 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e67016db-d5a2-4542-9e41-37d6812a9da6 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:42.387760 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e67016db-d5a2-4542-9e41-37d6812a9da6 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:42.540147 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e67016db-d5a2-4542-9e41-37d6812a9da6 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:42.548895 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e67016db-d5a2-4542-9e41-37d6812a9da6 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1318 microversion: 2.1 time: 0.179183 Aug 18 14:27:42.549707 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 183/365] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:42 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:43.580233 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2d1e1db5-cb7b-421a-a760-2125e71d147b tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:43.580988 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2d1e1db5-cb7b-421a-a760-2125e71d147b tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:43.587183 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d1e1db5-cb7b-421a-a760-2125e71d147b tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:43.587694 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d1e1db5-cb7b-421a-a760-2125e71d147b tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:43.588347 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d1e1db5-cb7b-421a-a760-2125e71d147b tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:43.589165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d1e1db5-cb7b-421a-a760-2125e71d147b tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:43.590001 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d1e1db5-cb7b-421a-a760-2125e71d147b tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:43.590424 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d1e1db5-cb7b-421a-a760-2125e71d147b tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:43.725089 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2d1e1db5-cb7b-421a-a760-2125e71d147b tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:43.732793 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2d1e1db5-cb7b-421a-a760-2125e71d147b tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1506 microversion: 2.1 time: 0.157561 Aug 18 14:27:43.733358 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 183/366] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:27:43 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:27:52.262596 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9e5dc44b-315b-4fac-b3d5-1cb76e817b9c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:52.263147 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9e5dc44b-315b-4fac-b3d5-1cb76e817b9c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:52.269825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e5dc44b-315b-4fac-b3d5-1cb76e817b9c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:52.270314 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e5dc44b-315b-4fac-b3d5-1cb76e817b9c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:52.270758 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e5dc44b-315b-4fac-b3d5-1cb76e817b9c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:52.272228 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e5dc44b-315b-4fac-b3d5-1cb76e817b9c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:52.272692 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e5dc44b-315b-4fac-b3d5-1cb76e817b9c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:52.273127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e5dc44b-315b-4fac-b3d5-1cb76e817b9c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:52.295982 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9e5dc44b-315b-4fac-b3d5-1cb76e817b9c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/ips" status: 200 len: 152 microversion: 2.20 time: 0.037292 Aug 18 14:27:52.296560 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 184/367] 10.222.0.39 () {60 vars in 1289 bytes} [Thu Aug 18 14:27:52 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:27:54.573572 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-54742d9f-b454-4176-88b8-38148917e944 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:27:54.574138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-54742d9f-b454-4176-88b8-38148917e944 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:54.576169 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:54.576824 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=62 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:54.582381 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54742d9f-b454-4176-88b8-38148917e944 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:54.582867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54742d9f-b454-4176-88b8-38148917e944 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:54.583407 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54742d9f-b454-4176-88b8-38148917e944 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:54.584724 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54742d9f-b454-4176-88b8-38148917e944 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:54.585101 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54742d9f-b454-4176-88b8-38148917e944 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:54.585614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54742d9f-b454-4176-88b8-38148917e944 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:54.612691 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-54742d9f-b454-4176-88b8-38148917e944 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lazy-loading 'flavor' on Instance uuid 95d09be0-5622-4167-859a-c81e38fc7218 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:27:54.850248 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-54742d9f-b454-4176-88b8-38148917e944 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "POST /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/action" status: 202 len: 0 microversion: 2.20 time: 0.280509 Aug 18 14:27:54.850877 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 184/368] 10.222.0.39 () {62 vars in 1319 bytes} [Thu Aug 18 14:27:54 2022] POST /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:27:54.859030 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-224d508f-7104-47cd-9c04-284a58fd2155 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:54.859672 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-224d508f-7104-47cd-9c04-284a58fd2155 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:54.866512 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-224d508f-7104-47cd-9c04-284a58fd2155 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:54.866919 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-224d508f-7104-47cd-9c04-284a58fd2155 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:54.867356 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-224d508f-7104-47cd-9c04-284a58fd2155 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:54.868092 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-224d508f-7104-47cd-9c04-284a58fd2155 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:54.868550 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-224d508f-7104-47cd-9c04-284a58fd2155 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:54.868975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-224d508f-7104-47cd-9c04-284a58fd2155 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:55.004191 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-224d508f-7104-47cd-9c04-284a58fd2155 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:55.013777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-224d508f-7104-47cd-9c04-284a58fd2155 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:55.015708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-224d508f-7104-47cd-9c04-284a58fd2155 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:55.016964 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-224d508f-7104-47cd-9c04-284a58fd2155 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.161868 Aug 18 14:27:55.017803 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 185/369] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:27:54 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:27:56.042463 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0ae26531-4f79-4d85-853f-bff460922b93 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:56.043152 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0ae26531-4f79-4d85-853f-bff460922b93 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:56.049920 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ae26531-4f79-4d85-853f-bff460922b93 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:56.050405 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ae26531-4f79-4d85-853f-bff460922b93 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:56.050841 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ae26531-4f79-4d85-853f-bff460922b93 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:56.051566 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ae26531-4f79-4d85-853f-bff460922b93 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:56.052049 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ae26531-4f79-4d85-853f-bff460922b93 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:56.052543 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ae26531-4f79-4d85-853f-bff460922b93 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:56.203102 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0ae26531-4f79-4d85-853f-bff460922b93 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:56.211720 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0ae26531-4f79-4d85-853f-bff460922b93 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:56.213227 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0ae26531-4f79-4d85-853f-bff460922b93 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:56.214557 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0ae26531-4f79-4d85-853f-bff460922b93 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.177034 Aug 18 14:27:56.215220 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 185/370] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:27:56 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:27:57.237578 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-32114211-3bf5-4dc5-9550-807ecf286b0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:57.238184 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-32114211-3bf5-4dc5-9550-807ecf286b0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:57.242517 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:27:57.246415 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32114211-3bf5-4dc5-9550-807ecf286b0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:57.246891 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32114211-3bf5-4dc5-9550-807ecf286b0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:57.247322 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32114211-3bf5-4dc5-9550-807ecf286b0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:57.248268 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32114211-3bf5-4dc5-9550-807ecf286b0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:57.248799 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32114211-3bf5-4dc5-9550-807ecf286b0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:57.249218 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32114211-3bf5-4dc5-9550-807ecf286b0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:57.388430 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-32114211-3bf5-4dc5-9550-807ecf286b0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:57.396641 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-32114211-3bf5-4dc5-9550-807ecf286b0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:57.398138 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-32114211-3bf5-4dc5-9550-807ecf286b0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:57.399285 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-32114211-3bf5-4dc5-9550-807ecf286b0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.165647 Aug 18 14:27:57.399874 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 186/371] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:27:57 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:27:58.422112 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-51ed97de-426d-4f21-9abe-6e022e5937e3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:58.422745 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-51ed97de-426d-4f21-9abe-6e022e5937e3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:58.429323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51ed97de-426d-4f21-9abe-6e022e5937e3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:58.429802 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51ed97de-426d-4f21-9abe-6e022e5937e3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:58.430241 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51ed97de-426d-4f21-9abe-6e022e5937e3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:58.430934 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51ed97de-426d-4f21-9abe-6e022e5937e3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:58.431573 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51ed97de-426d-4f21-9abe-6e022e5937e3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:58.431850 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51ed97de-426d-4f21-9abe-6e022e5937e3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:58.565774 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-51ed97de-426d-4f21-9abe-6e022e5937e3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:58.574601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-51ed97de-426d-4f21-9abe-6e022e5937e3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:58.576141 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-51ed97de-426d-4f21-9abe-6e022e5937e3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:58.577291 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-51ed97de-426d-4f21-9abe-6e022e5937e3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.159193 Aug 18 14:27:58.577846 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 186/372] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:27:58 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:27:59.601870 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8ab9f628-92da-4ae3-8463-566b339c845c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:27:59.602484 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8ab9f628-92da-4ae3-8463-566b339c845c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:27:59.610061 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ab9f628-92da-4ae3-8463-566b339c845c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:59.610488 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ab9f628-92da-4ae3-8463-566b339c845c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:59.611128 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ab9f628-92da-4ae3-8463-566b339c845c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:59.612015 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ab9f628-92da-4ae3-8463-566b339c845c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:27:59.612470 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ab9f628-92da-4ae3-8463-566b339c845c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:27:59.612895 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ab9f628-92da-4ae3-8463-566b339c845c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:27:59.740235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8ab9f628-92da-4ae3-8463-566b339c845c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:59.748292 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8ab9f628-92da-4ae3-8463-566b339c845c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:59.749792 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8ab9f628-92da-4ae3-8463-566b339c845c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:27:59.750939 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8ab9f628-92da-4ae3-8463-566b339c845c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.153544 Aug 18 14:27:59.751515 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 187/373] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:27:59 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:00.774904 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cbbe2d9e-dc74-4772-8e5e-624c682e803a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:00.775459 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cbbe2d9e-dc74-4772-8e5e-624c682e803a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:00.781465 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbbe2d9e-dc74-4772-8e5e-624c682e803a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:00.781944 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbbe2d9e-dc74-4772-8e5e-624c682e803a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:00.782376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbbe2d9e-dc74-4772-8e5e-624c682e803a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:00.783059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbbe2d9e-dc74-4772-8e5e-624c682e803a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:00.783547 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbbe2d9e-dc74-4772-8e5e-624c682e803a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:00.783972 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbbe2d9e-dc74-4772-8e5e-624c682e803a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:00.912348 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cbbe2d9e-dc74-4772-8e5e-624c682e803a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:00.921279 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cbbe2d9e-dc74-4772-8e5e-624c682e803a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:00.922782 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cbbe2d9e-dc74-4772-8e5e-624c682e803a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:00.924185 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cbbe2d9e-dc74-4772-8e5e-624c682e803a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.153621 Aug 18 14:28:00.925190 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 187/374] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:00 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:01.949368 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1c7c3af5-e9b4-4b1f-91fd-fccf72301c6a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:01.950005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1c7c3af5-e9b4-4b1f-91fd-fccf72301c6a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:01.956552 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c7c3af5-e9b4-4b1f-91fd-fccf72301c6a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:01.957027 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c7c3af5-e9b4-4b1f-91fd-fccf72301c6a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:01.957462 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c7c3af5-e9b4-4b1f-91fd-fccf72301c6a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:01.958900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c7c3af5-e9b4-4b1f-91fd-fccf72301c6a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:01.959351 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c7c3af5-e9b4-4b1f-91fd-fccf72301c6a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:01.960718 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c7c3af5-e9b4-4b1f-91fd-fccf72301c6a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:02.103458 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1c7c3af5-e9b4-4b1f-91fd-fccf72301c6a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:02.116319 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1c7c3af5-e9b4-4b1f-91fd-fccf72301c6a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:02.118200 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1c7c3af5-e9b4-4b1f-91fd-fccf72301c6a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:02.119391 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1c7c3af5-e9b4-4b1f-91fd-fccf72301c6a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.174079 Aug 18 14:28:02.124658 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 188/375] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:01 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:03.142755 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-525e9cc5-9c24-4702-b560-da3a246cbc41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:03.143731 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-525e9cc5-9c24-4702-b560-da3a246cbc41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:03.150722 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-525e9cc5-9c24-4702-b560-da3a246cbc41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:03.151203 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-525e9cc5-9c24-4702-b560-da3a246cbc41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:03.151671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-525e9cc5-9c24-4702-b560-da3a246cbc41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:03.152363 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-525e9cc5-9c24-4702-b560-da3a246cbc41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:03.152812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-525e9cc5-9c24-4702-b560-da3a246cbc41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:03.153233 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-525e9cc5-9c24-4702-b560-da3a246cbc41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:03.290309 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-525e9cc5-9c24-4702-b560-da3a246cbc41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:03.298437 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-525e9cc5-9c24-4702-b560-da3a246cbc41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:03.299984 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-525e9cc5-9c24-4702-b560-da3a246cbc41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:03.301142 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-525e9cc5-9c24-4702-b560-da3a246cbc41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.162513 Aug 18 14:28:03.301729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 188/376] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:03 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:04.239011 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ad3568ab-b6d4-4980-bfe5-7c7cd637d77a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5a8bdf8-4878-4340-8a23-318043070186", "device": "/dev/sdb"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:28:04.242839 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ad3568ab-b6d4-4980-bfe5-7c7cd637d77a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:04.249329 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad3568ab-b6d4-4980-bfe5-7c7cd637d77a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:04.249809 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad3568ab-b6d4-4980-bfe5-7c7cd637d77a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:04.250251 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad3568ab-b6d4-4980-bfe5-7c7cd637d77a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:04.250943 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad3568ab-b6d4-4980-bfe5-7c7cd637d77a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:04.251419 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad3568ab-b6d4-4980-bfe5-7c7cd637d77a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:04.251852 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad3568ab-b6d4-4980-bfe5-7c7cd637d77a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:04.324446 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-852ea561-d5b0-415c-878f-494fe2d490cf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:04.325068 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-852ea561-d5b0-415c-878f-494fe2d490cf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:04.331693 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-852ea561-d5b0-415c-878f-494fe2d490cf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:04.332188 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-852ea561-d5b0-415c-878f-494fe2d490cf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:04.332627 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-852ea561-d5b0-415c-878f-494fe2d490cf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:04.333348 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-852ea561-d5b0-415c-878f-494fe2d490cf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:04.333905 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-852ea561-d5b0-415c-878f-494fe2d490cf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:04.334334 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-852ea561-d5b0-415c-878f-494fe2d490cf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:04.470872 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-852ea561-d5b0-415c-878f-494fe2d490cf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:04.479993 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-852ea561-d5b0-415c-878f-494fe2d490cf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:04.481529 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-852ea561-d5b0-415c-878f-494fe2d490cf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:04.482920 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-852ea561-d5b0-415c-878f-494fe2d490cf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.162336 Aug 18 14:28:04.483514 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 189/377] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:04 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:28:04.507831 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ad3568ab-b6d4-4980-bfe5-7c7cd637d77a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "POST /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272499 Aug 18 14:28:04.508629 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 189/378] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:28:04 2022] POST /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:28:05.506151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-021c4221-5724-4068-a1d1-587eace780ca tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:05.506756 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-021c4221-5724-4068-a1d1-587eace780ca tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:05.512944 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-021c4221-5724-4068-a1d1-587eace780ca tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:05.513425 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-021c4221-5724-4068-a1d1-587eace780ca tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:05.513866 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-021c4221-5724-4068-a1d1-587eace780ca tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:05.514555 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-021c4221-5724-4068-a1d1-587eace780ca tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:05.515007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-021c4221-5724-4068-a1d1-587eace780ca tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:05.515462 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-021c4221-5724-4068-a1d1-587eace780ca tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:05.649779 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-021c4221-5724-4068-a1d1-587eace780ca tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:05.657845 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-021c4221-5724-4068-a1d1-587eace780ca tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:05.659326 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-021c4221-5724-4068-a1d1-587eace780ca tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:05.660496 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-021c4221-5724-4068-a1d1-587eace780ca tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.158368 Aug 18 14:28:05.661045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 190/379] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:05 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:06.684687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9b12486b-0a14-471b-8ad6-d0d753b25ad4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:06.685395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9b12486b-0a14-471b-8ad6-d0d753b25ad4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:06.691698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b12486b-0a14-471b-8ad6-d0d753b25ad4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:06.692778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b12486b-0a14-471b-8ad6-d0d753b25ad4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:06.693377 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b12486b-0a14-471b-8ad6-d0d753b25ad4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:06.694075 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b12486b-0a14-471b-8ad6-d0d753b25ad4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:06.694531 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b12486b-0a14-471b-8ad6-d0d753b25ad4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:06.694955 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b12486b-0a14-471b-8ad6-d0d753b25ad4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:06.822986 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9b12486b-0a14-471b-8ad6-d0d753b25ad4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:06.831078 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9b12486b-0a14-471b-8ad6-d0d753b25ad4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:06.832608 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9b12486b-0a14-471b-8ad6-d0d753b25ad4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:06.834341 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9b12486b-0a14-471b-8ad6-d0d753b25ad4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.154475 Aug 18 14:28:06.834894 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 190/380] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:06 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:07.858178 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-513808c8-c553-450f-b140-848c8b35b47e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:07.859060 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-513808c8-c553-450f-b140-848c8b35b47e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:07.865814 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-513808c8-c553-450f-b140-848c8b35b47e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:07.866293 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-513808c8-c553-450f-b140-848c8b35b47e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:07.866735 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-513808c8-c553-450f-b140-848c8b35b47e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:07.867474 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-513808c8-c553-450f-b140-848c8b35b47e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:07.867926 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-513808c8-c553-450f-b140-848c8b35b47e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:07.868347 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-513808c8-c553-450f-b140-848c8b35b47e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:08.008021 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-513808c8-c553-450f-b140-848c8b35b47e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:08.016551 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-513808c8-c553-450f-b140-848c8b35b47e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:08.018063 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-513808c8-c553-450f-b140-848c8b35b47e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:08.019236 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-513808c8-c553-450f-b140-848c8b35b47e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.165065 Aug 18 14:28:08.019850 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 191/381] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:07 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:09.044023 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-73c198fe-3db4-48ea-87c3-f7e0cee9be22 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:09.044732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-73c198fe-3db4-48ea-87c3-f7e0cee9be22 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:09.050830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73c198fe-3db4-48ea-87c3-f7e0cee9be22 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:09.051310 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73c198fe-3db4-48ea-87c3-f7e0cee9be22 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:09.051888 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73c198fe-3db4-48ea-87c3-f7e0cee9be22 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:09.052791 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73c198fe-3db4-48ea-87c3-f7e0cee9be22 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:09.053242 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73c198fe-3db4-48ea-87c3-f7e0cee9be22 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:09.053671 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73c198fe-3db4-48ea-87c3-f7e0cee9be22 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:09.068796 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:09.189724 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-73c198fe-3db4-48ea-87c3-f7e0cee9be22 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:09.198016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-73c198fe-3db4-48ea-87c3-f7e0cee9be22 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:09.199553 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-73c198fe-3db4-48ea-87c3-f7e0cee9be22 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:09.201274 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-73c198fe-3db4-48ea-87c3-f7e0cee9be22 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.160971 Aug 18 14:28:09.201963 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 191/382] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:09 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:10.225665 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6f39474c-95c7-48f9-b086-4a2e3b95e8f8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:10.226286 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6f39474c-95c7-48f9-b086-4a2e3b95e8f8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:10.232332 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f39474c-95c7-48f9-b086-4a2e3b95e8f8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:10.232821 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f39474c-95c7-48f9-b086-4a2e3b95e8f8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:10.233260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f39474c-95c7-48f9-b086-4a2e3b95e8f8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:10.233957 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f39474c-95c7-48f9-b086-4a2e3b95e8f8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:10.234412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f39474c-95c7-48f9-b086-4a2e3b95e8f8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:10.234899 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f39474c-95c7-48f9-b086-4a2e3b95e8f8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:10.368890 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6f39474c-95c7-48f9-b086-4a2e3b95e8f8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:10.377067 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6f39474c-95c7-48f9-b086-4a2e3b95e8f8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:10.378574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6f39474c-95c7-48f9-b086-4a2e3b95e8f8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:10.380282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6f39474c-95c7-48f9-b086-4a2e3b95e8f8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.158170 Aug 18 14:28:10.380950 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 192/383] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:10 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:11.406531 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f95dc668-e104-46b0-aea6-defc2313274f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:11.407141 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f95dc668-e104-46b0-aea6-defc2313274f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:11.414308 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f95dc668-e104-46b0-aea6-defc2313274f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:11.415114 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f95dc668-e104-46b0-aea6-defc2313274f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:11.415581 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f95dc668-e104-46b0-aea6-defc2313274f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:11.416263 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f95dc668-e104-46b0-aea6-defc2313274f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:11.416710 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f95dc668-e104-46b0-aea6-defc2313274f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:11.417128 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f95dc668-e104-46b0-aea6-defc2313274f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:11.544462 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f95dc668-e104-46b0-aea6-defc2313274f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:11.552779 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f95dc668-e104-46b0-aea6-defc2313274f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:11.554319 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f95dc668-e104-46b0-aea6-defc2313274f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:11.555496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f95dc668-e104-46b0-aea6-defc2313274f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.153067 Aug 18 14:28:11.556053 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 192/384] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:11 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:12.578887 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b7889507-e2ff-4663-9a2d-5dd6b01939e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:12.579528 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b7889507-e2ff-4663-9a2d-5dd6b01939e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:12.585499 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7889507-e2ff-4663-9a2d-5dd6b01939e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:12.585975 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7889507-e2ff-4663-9a2d-5dd6b01939e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:12.586406 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7889507-e2ff-4663-9a2d-5dd6b01939e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:12.587121 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7889507-e2ff-4663-9a2d-5dd6b01939e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:12.587600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7889507-e2ff-4663-9a2d-5dd6b01939e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:12.588030 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7889507-e2ff-4663-9a2d-5dd6b01939e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:12.720333 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b7889507-e2ff-4663-9a2d-5dd6b01939e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:12.729233 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b7889507-e2ff-4663-9a2d-5dd6b01939e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:12.730752 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b7889507-e2ff-4663-9a2d-5dd6b01939e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:12.731922 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b7889507-e2ff-4663-9a2d-5dd6b01939e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.157008 Aug 18 14:28:12.732489 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 193/385] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:12 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:13.756058 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-73075ece-1d49-4ce7-92d0-95396b8680b7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:13.756628 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-73075ece-1d49-4ce7-92d0-95396b8680b7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:13.763204 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73075ece-1d49-4ce7-92d0-95396b8680b7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:13.763727 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73075ece-1d49-4ce7-92d0-95396b8680b7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:13.764170 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73075ece-1d49-4ce7-92d0-95396b8680b7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:13.764861 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73075ece-1d49-4ce7-92d0-95396b8680b7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:13.765317 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73075ece-1d49-4ce7-92d0-95396b8680b7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:13.765741 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73075ece-1d49-4ce7-92d0-95396b8680b7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:13.899805 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-73075ece-1d49-4ce7-92d0-95396b8680b7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:13.907894 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-73075ece-1d49-4ce7-92d0-95396b8680b7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:13.909391 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-73075ece-1d49-4ce7-92d0-95396b8680b7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:13.911032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-73075ece-1d49-4ce7-92d0-95396b8680b7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.159164 Aug 18 14:28:13.911679 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 193/386] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:13 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:14.934484 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-074a842f-a3ad-4172-bcc8-ace97a827ba2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:14.935157 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-074a842f-a3ad-4172-bcc8-ace97a827ba2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:14.941096 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-074a842f-a3ad-4172-bcc8-ace97a827ba2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:14.941574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-074a842f-a3ad-4172-bcc8-ace97a827ba2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:14.942185 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-074a842f-a3ad-4172-bcc8-ace97a827ba2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:14.943050 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-074a842f-a3ad-4172-bcc8-ace97a827ba2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:14.943612 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-074a842f-a3ad-4172-bcc8-ace97a827ba2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:14.944040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-074a842f-a3ad-4172-bcc8-ace97a827ba2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:15.080447 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-074a842f-a3ad-4172-bcc8-ace97a827ba2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:15.093509 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-074a842f-a3ad-4172-bcc8-ace97a827ba2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:15.095032 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-074a842f-a3ad-4172-bcc8-ace97a827ba2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:15.096216 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-074a842f-a3ad-4172-bcc8-ace97a827ba2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.165646 Aug 18 14:28:15.096774 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 194/387] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:14 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:16.121022 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a014ddb4-1c0c-4a6d-ba81-2c02e08ccd27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:16.122157 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a014ddb4-1c0c-4a6d-ba81-2c02e08ccd27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:16.128758 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a014ddb4-1c0c-4a6d-ba81-2c02e08ccd27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:16.129283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a014ddb4-1c0c-4a6d-ba81-2c02e08ccd27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:16.130004 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a014ddb4-1c0c-4a6d-ba81-2c02e08ccd27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:16.130738 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a014ddb4-1c0c-4a6d-ba81-2c02e08ccd27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:16.131184 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a014ddb4-1c0c-4a6d-ba81-2c02e08ccd27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:16.131638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a014ddb4-1c0c-4a6d-ba81-2c02e08ccd27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:16.284899 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a014ddb4-1c0c-4a6d-ba81-2c02e08ccd27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:16.294380 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a014ddb4-1c0c-4a6d-ba81-2c02e08ccd27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:16.295921 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a014ddb4-1c0c-4a6d-ba81-2c02e08ccd27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:16.297079 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a014ddb4-1c0c-4a6d-ba81-2c02e08ccd27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.180026 Aug 18 14:28:16.297628 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 194/388] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:16 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:17.322000 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d3aef380-4a60-4b7b-a970-c92059f54461 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:17.322635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d3aef380-4a60-4b7b-a970-c92059f54461 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:17.328629 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3aef380-4a60-4b7b-a970-c92059f54461 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:17.329104 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3aef380-4a60-4b7b-a970-c92059f54461 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:17.329568 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3aef380-4a60-4b7b-a970-c92059f54461 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:17.330262 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3aef380-4a60-4b7b-a970-c92059f54461 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:17.330733 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3aef380-4a60-4b7b-a970-c92059f54461 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:17.331117 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3aef380-4a60-4b7b-a970-c92059f54461 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:17.478959 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d3aef380-4a60-4b7b-a970-c92059f54461 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:17.487318 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d3aef380-4a60-4b7b-a970-c92059f54461 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:17.489608 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d3aef380-4a60-4b7b-a970-c92059f54461 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:17.490729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d3aef380-4a60-4b7b-a970-c92059f54461 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.173577 Aug 18 14:28:17.491465 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 195/389] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:17 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:18.514867 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b5170553-73e1-4ff1-b70e-b2149c0710a9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:18.515497 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b5170553-73e1-4ff1-b70e-b2149c0710a9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:18.523002 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5170553-73e1-4ff1-b70e-b2149c0710a9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:18.523610 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5170553-73e1-4ff1-b70e-b2149c0710a9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:18.524041 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5170553-73e1-4ff1-b70e-b2149c0710a9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:18.524743 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5170553-73e1-4ff1-b70e-b2149c0710a9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:18.525194 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5170553-73e1-4ff1-b70e-b2149c0710a9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:18.525619 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5170553-73e1-4ff1-b70e-b2149c0710a9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:18.654354 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b5170553-73e1-4ff1-b70e-b2149c0710a9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:18.662922 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b5170553-73e1-4ff1-b70e-b2149c0710a9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:18.664436 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b5170553-73e1-4ff1-b70e-b2149c0710a9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:18.665574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b5170553-73e1-4ff1-b70e-b2149c0710a9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1743 microversion: 2.20 time: 0.154614 Aug 18 14:28:18.666131 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 195/390] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:18 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:19.689186 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b36bb8fa-1b6c-4970-bc3e-3f7c3c085806 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:19.689719 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b36bb8fa-1b6c-4970-bc3e-3f7c3c085806 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:19.696083 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b36bb8fa-1b6c-4970-bc3e-3f7c3c085806 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:19.696567 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b36bb8fa-1b6c-4970-bc3e-3f7c3c085806 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:19.697004 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b36bb8fa-1b6c-4970-bc3e-3f7c3c085806 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:19.697720 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b36bb8fa-1b6c-4970-bc3e-3f7c3c085806 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:19.698173 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b36bb8fa-1b6c-4970-bc3e-3f7c3c085806 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:19.698600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b36bb8fa-1b6c-4970-bc3e-3f7c3c085806 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:19.828338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b36bb8fa-1b6c-4970-bc3e-3f7c3c085806 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:19.837212 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b36bb8fa-1b6c-4970-bc3e-3f7c3c085806 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:19.838714 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b36bb8fa-1b6c-4970-bc3e-3f7c3c085806 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:19.839911 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b36bb8fa-1b6c-4970-bc3e-3f7c3c085806 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1743 microversion: 2.20 time: 0.154664 Aug 18 14:28:19.840476 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 196/391] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:19 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:20.863136 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d5fcfcf2-137e-406c-ae1a-4aace9331cb6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:20.863725 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d5fcfcf2-137e-406c-ae1a-4aace9331cb6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:20.870107 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5fcfcf2-137e-406c-ae1a-4aace9331cb6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:20.870583 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5fcfcf2-137e-406c-ae1a-4aace9331cb6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:20.871011 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5fcfcf2-137e-406c-ae1a-4aace9331cb6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:20.871728 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5fcfcf2-137e-406c-ae1a-4aace9331cb6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:20.872176 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5fcfcf2-137e-406c-ae1a-4aace9331cb6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:20.872596 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5fcfcf2-137e-406c-ae1a-4aace9331cb6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:21.007903 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d5fcfcf2-137e-406c-ae1a-4aace9331cb6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:21.016055 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d5fcfcf2-137e-406c-ae1a-4aace9331cb6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:21.018005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d5fcfcf2-137e-406c-ae1a-4aace9331cb6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:21.018701 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d5fcfcf2-137e-406c-ae1a-4aace9331cb6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1743 microversion: 2.20 time: 0.159483 Aug 18 14:28:21.019265 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 196/392] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:20 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:22.043986 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-efa84aa4-52d1-43b6-aadf-51f75d5c4472 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:22.044988 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-efa84aa4-52d1-43b6-aadf-51f75d5c4472 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:22.053424 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efa84aa4-52d1-43b6-aadf-51f75d5c4472 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:22.053904 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efa84aa4-52d1-43b6-aadf-51f75d5c4472 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:22.054335 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efa84aa4-52d1-43b6-aadf-51f75d5c4472 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:22.055037 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efa84aa4-52d1-43b6-aadf-51f75d5c4472 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:22.055511 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efa84aa4-52d1-43b6-aadf-51f75d5c4472 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:22.055933 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efa84aa4-52d1-43b6-aadf-51f75d5c4472 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:22.229487 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-efa84aa4-52d1-43b6-aadf-51f75d5c4472 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:22.245286 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-efa84aa4-52d1-43b6-aadf-51f75d5c4472 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:22.246963 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-efa84aa4-52d1-43b6-aadf-51f75d5c4472 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:22.248227 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-efa84aa4-52d1-43b6-aadf-51f75d5c4472 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1738 microversion: 2.20 time: 0.209388 Aug 18 14:28:22.248784 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 197/393] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:22 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:23.277053 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-33f59e16-ff3f-4132-a202-0ea324827f95 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:23.277573 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-33f59e16-ff3f-4132-a202-0ea324827f95 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:23.284311 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33f59e16-ff3f-4132-a202-0ea324827f95 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:23.284800 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33f59e16-ff3f-4132-a202-0ea324827f95 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:23.285776 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33f59e16-ff3f-4132-a202-0ea324827f95 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:23.286912 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33f59e16-ff3f-4132-a202-0ea324827f95 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:23.287391 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33f59e16-ff3f-4132-a202-0ea324827f95 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:23.287815 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33f59e16-ff3f-4132-a202-0ea324827f95 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:23.436129 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-33f59e16-ff3f-4132-a202-0ea324827f95 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:23.446300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-33f59e16-ff3f-4132-a202-0ea324827f95 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:23.448107 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-33f59e16-ff3f-4132-a202-0ea324827f95 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:23.452045 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-33f59e16-ff3f-4132-a202-0ea324827f95 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1738 microversion: 2.20 time: 0.182753 Aug 18 14:28:23.453354 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 197/394] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:23 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:24.245307 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-5f49090e-a2dd-4be7-a9a0-7403dcc47c24 req-107e615c-7ba0-4c56-8e8d-d8ce401c90ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d09be0-5622-4167-859a-c81e38fc7218", "name": "network-vif-plugged", "status": "completed", "tag": "ce6e4f0c-73f1-4b80-9e83-e467ad9ba266"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:28:24.257850 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5f49090e-a2dd-4be7-a9a0-7403dcc47c24 req-107e615c-7ba0-4c56-8e8d-d8ce401c90ff service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:24.258732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5f49090e-a2dd-4be7-a9a0-7403dcc47c24 req-107e615c-7ba0-4c56-8e8d-d8ce401c90ff service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:24.259245 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5f49090e-a2dd-4be7-a9a0-7403dcc47c24 req-107e615c-7ba0-4c56-8e8d-d8ce401c90ff service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:24.274463 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-5f49090e-a2dd-4be7-a9a0-7403dcc47c24 req-107e615c-7ba0-4c56-8e8d-d8ce401c90ff service nova] Creating event network-vif-plugged:ce6e4f0c-73f1-4b80-9e83-e467ad9ba266 for instance 95d09be0-5622-4167-859a-c81e38fc7218 on hv-cinder-85220 Aug 18 14:28:24.296626 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-5f49090e-a2dd-4be7-a9a0-7403dcc47c24 req-107e615c-7ba0-4c56-8e8d-d8ce401c90ff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054330 Aug 18 14:28:24.297375 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 198/395] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:28:24.476753 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5400927d-356d-413f-9bd9-c5c326ad75cc tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:24.477723 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5400927d-356d-413f-9bd9-c5c326ad75cc tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:24.483775 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5400927d-356d-413f-9bd9-c5c326ad75cc tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:24.484439 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5400927d-356d-413f-9bd9-c5c326ad75cc tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:24.484873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5400927d-356d-413f-9bd9-c5c326ad75cc tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:24.485629 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5400927d-356d-413f-9bd9-c5c326ad75cc tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:24.485992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5400927d-356d-413f-9bd9-c5c326ad75cc tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:24.486870 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5400927d-356d-413f-9bd9-c5c326ad75cc tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:24.636276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5400927d-356d-413f-9bd9-c5c326ad75cc tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:24.646357 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5400927d-356d-413f-9bd9-c5c326ad75cc tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:24.648199 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5400927d-356d-413f-9bd9-c5c326ad75cc tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:24.649561 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5400927d-356d-413f-9bd9-c5c326ad75cc tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1738 microversion: 2.20 time: 0.177665 Aug 18 14:28:24.650250 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 198/396] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:24 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:25.673546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7dca25ff-0997-48f0-8dac-cdd285241595 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:25.674370 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7dca25ff-0997-48f0-8dac-cdd285241595 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:25.677121 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=31 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:25.682715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dca25ff-0997-48f0-8dac-cdd285241595 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:25.683311 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dca25ff-0997-48f0-8dac-cdd285241595 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:25.683825 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dca25ff-0997-48f0-8dac-cdd285241595 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:25.684777 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dca25ff-0997-48f0-8dac-cdd285241595 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:25.685367 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dca25ff-0997-48f0-8dac-cdd285241595 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:25.685997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dca25ff-0997-48f0-8dac-cdd285241595 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:25.689585 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:25.862041 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7dca25ff-0997-48f0-8dac-cdd285241595 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:25.873672 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7dca25ff-0997-48f0-8dac-cdd285241595 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:25.875544 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7dca25ff-0997-48f0-8dac-cdd285241595 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:25.876918 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7dca25ff-0997-48f0-8dac-cdd285241595 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1738 microversion: 2.20 time: 0.207739 Aug 18 14:28:25.877608 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 199/397] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:25 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:26.938253 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b8e03235-9dc4-430c-9f68-b109ed650b92 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:26.939866 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b8e03235-9dc4-430c-9f68-b109ed650b92 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:26.947134 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e03235-9dc4-430c-9f68-b109ed650b92 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:26.947652 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e03235-9dc4-430c-9f68-b109ed650b92 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:26.948084 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e03235-9dc4-430c-9f68-b109ed650b92 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:26.948778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e03235-9dc4-430c-9f68-b109ed650b92 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:26.949223 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e03235-9dc4-430c-9f68-b109ed650b92 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:26.949643 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e03235-9dc4-430c-9f68-b109ed650b92 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:27.105476 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b8e03235-9dc4-430c-9f68-b109ed650b92 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:27.116615 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b8e03235-9dc4-430c-9f68-b109ed650b92 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:27.118111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b8e03235-9dc4-430c-9f68-b109ed650b92 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:27.119403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b8e03235-9dc4-430c-9f68-b109ed650b92 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1738 microversion: 2.20 time: 0.213562 Aug 18 14:28:27.119978 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 199/398] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:26 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:28.143323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d69a2611-1c33-4904-b43a-ce833786aa1b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:28.143985 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d69a2611-1c33-4904-b43a-ce833786aa1b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:28.151628 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d69a2611-1c33-4904-b43a-ce833786aa1b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:28.153363 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d69a2611-1c33-4904-b43a-ce833786aa1b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:28.153812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d69a2611-1c33-4904-b43a-ce833786aa1b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:28.154526 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d69a2611-1c33-4904-b43a-ce833786aa1b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:28.154981 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d69a2611-1c33-4904-b43a-ce833786aa1b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:28.155432 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d69a2611-1c33-4904-b43a-ce833786aa1b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:28.309424 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d69a2611-1c33-4904-b43a-ce833786aa1b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:28.322453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d69a2611-1c33-4904-b43a-ce833786aa1b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:28.324007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d69a2611-1c33-4904-b43a-ce833786aa1b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:28.325208 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d69a2611-1c33-4904-b43a-ce833786aa1b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1738 microversion: 2.20 time: 0.186854 Aug 18 14:28:28.325799 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 200/399] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:28 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:29.351793 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e0fdfcd2-af0b-4795-8b84-b1c67a198fb0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:29.352382 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e0fdfcd2-af0b-4795-8b84-b1c67a198fb0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:29.354891 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=28 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:29.365726 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0fdfcd2-af0b-4795-8b84-b1c67a198fb0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:29.366371 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0fdfcd2-af0b-4795-8b84-b1c67a198fb0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:29.366862 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0fdfcd2-af0b-4795-8b84-b1c67a198fb0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:29.367595 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0fdfcd2-af0b-4795-8b84-b1c67a198fb0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:29.368046 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0fdfcd2-af0b-4795-8b84-b1c67a198fb0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:29.368497 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0fdfcd2-af0b-4795-8b84-b1c67a198fb0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:29.523145 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e0fdfcd2-af0b-4795-8b84-b1c67a198fb0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:29.532953 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e0fdfcd2-af0b-4795-8b84-b1c67a198fb0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:29.534990 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e0fdfcd2-af0b-4795-8b84-b1c67a198fb0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:29.537025 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e0fdfcd2-af0b-4795-8b84-b1c67a198fb0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1738 microversion: 2.20 time: 0.190222 Aug 18 14:28:29.538136 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 200/400] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:29 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:30.564213 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7ed754fb-e56e-48ca-b602-8eeee1263e68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:30.565094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7ed754fb-e56e-48ca-b602-8eeee1263e68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:30.572467 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ed754fb-e56e-48ca-b602-8eeee1263e68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:30.573340 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ed754fb-e56e-48ca-b602-8eeee1263e68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:30.574261 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ed754fb-e56e-48ca-b602-8eeee1263e68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:30.575486 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ed754fb-e56e-48ca-b602-8eeee1263e68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:30.576007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ed754fb-e56e-48ca-b602-8eeee1263e68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:30.576507 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ed754fb-e56e-48ca-b602-8eeee1263e68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:30.715931 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7ed754fb-e56e-48ca-b602-8eeee1263e68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:30.724453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7ed754fb-e56e-48ca-b602-8eeee1263e68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:30.725954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7ed754fb-e56e-48ca-b602-8eeee1263e68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:30.727109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7ed754fb-e56e-48ca-b602-8eeee1263e68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1738 microversion: 2.20 time: 0.168119 Aug 18 14:28:30.727714 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 201/401] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:30 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:31.750212 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a2bd06a3-a28d-48fc-a62a-987c90b51547 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:31.750751 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a2bd06a3-a28d-48fc-a62a-987c90b51547 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:31.757155 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2bd06a3-a28d-48fc-a62a-987c90b51547 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:31.757640 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2bd06a3-a28d-48fc-a62a-987c90b51547 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:31.758070 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2bd06a3-a28d-48fc-a62a-987c90b51547 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:31.758763 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2bd06a3-a28d-48fc-a62a-987c90b51547 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:31.759218 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2bd06a3-a28d-48fc-a62a-987c90b51547 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:31.759671 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2bd06a3-a28d-48fc-a62a-987c90b51547 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:31.891653 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a2bd06a3-a28d-48fc-a62a-987c90b51547 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:31.900438 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a2bd06a3-a28d-48fc-a62a-987c90b51547 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:31.901951 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a2bd06a3-a28d-48fc-a62a-987c90b51547 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:31.903112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a2bd06a3-a28d-48fc-a62a-987c90b51547 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1720 microversion: 2.20 time: 0.156894 Aug 18 14:28:31.903713 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 201/402] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:31 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:32.035626 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d8e7e37d-ca4a-4bb1-af21-965fe79d8b13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:32.036177 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d8e7e37d-ca4a-4bb1-af21-965fe79d8b13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:32.042383 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8e7e37d-ca4a-4bb1-af21-965fe79d8b13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:32.042860 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8e7e37d-ca4a-4bb1-af21-965fe79d8b13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:32.043292 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8e7e37d-ca4a-4bb1-af21-965fe79d8b13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:32.043998 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8e7e37d-ca4a-4bb1-af21-965fe79d8b13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:32.044448 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8e7e37d-ca4a-4bb1-af21-965fe79d8b13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:32.044872 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8e7e37d-ca4a-4bb1-af21-965fe79d8b13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:32.068491 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d8e7e37d-ca4a-4bb1-af21-965fe79d8b13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4/ips" status: 200 len: 148 microversion: 2.1 time: 0.037259 Aug 18 14:28:32.069036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 202/403] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Aug 18 14:28:32 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:28:32.080146 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b0b19fa8-37ab-499d-aa59-a8475469e552 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8487ce6f-1020-416c-a636-52d38f01b805"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:28:32.083230 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b0b19fa8-37ab-499d-aa59-a8475469e552 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:32.089468 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0b19fa8-37ab-499d-aa59-a8475469e552 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:32.089960 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0b19fa8-37ab-499d-aa59-a8475469e552 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:32.090437 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0b19fa8-37ab-499d-aa59-a8475469e552 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:32.091137 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0b19fa8-37ab-499d-aa59-a8475469e552 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:32.091630 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0b19fa8-37ab-499d-aa59-a8475469e552 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:32.092056 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0b19fa8-37ab-499d-aa59-a8475469e552 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:32.170965 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-b0b19fa8-37ab-499d-aa59-a8475469e552 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Invalid volume: volume 8487ce6f-1020-416c-a636-52d38f01b805 is already attached to instances: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b0b19fa8-37ab-499d-aa59-a8475469e552 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: POST /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4/os-volume_attachments HTTP/1.1 Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 74 Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:28:32.172746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:28:32.174360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:28:32.174360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:28:32.174360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:28:32.174360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:28:32.174360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:28:32.174360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:28:32.174360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:28:32.174360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:28:32.174360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:28:32.174360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Aug 18 14:28:32.174360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {"volumeAttachment": {"volumeId": "8487ce6f-1020-416c-a636-52d38f01b805"}} Aug 18 14:28:32.174360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Invalid volume: volume 8487ce6f-1020-416c-a636-52d38f01b805 is already attached to instances: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'server_id': 'b7926083-e26a-4fa9-bd23-73d13c892da4', 'body': {'volumeAttachment': {'volumeId': '8487ce6f-1020-416c-a636-52d38f01b805'}}} Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5122, in attach_volume Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4962, in _check_volume_already_attached Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8487ce6f-1020-416c-a636-52d38f01b805 is already attached to instances: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:28:32.175860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8487ce6f-1020-416c-a636-52d38f01b805 is already attached to instances: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:28:32.177572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:28:32.179122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:28:32.179122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:28:32.179122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:28:32.179122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8487ce6f-1020-416c-a636-52d38f01b805 is already attached to instances: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f Aug 18 14:28:32.179122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:28:32.179122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b0b19fa8-37ab-499d-aa59-a8475469e552 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 400 to user: Invalid volume: volume 8487ce6f-1020-416c-a636-52d38f01b805 is already attached to instances: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:28:32.179122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b0b19fa8-37ab-499d-aa59-a8475469e552 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "POST /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098007 Aug 18 14:28:32.179122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 202/404] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:28:32 2022] POST /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:28:32.184339 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dd4fafe6-bd80-46ac-b9fc-3814158757cc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:32.184841 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dd4fafe6-bd80-46ac-b9fc-3814158757cc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:32.190917 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd4fafe6-bd80-46ac-b9fc-3814158757cc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:32.192072 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd4fafe6-bd80-46ac-b9fc-3814158757cc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:32.192540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd4fafe6-bd80-46ac-b9fc-3814158757cc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:32.193232 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd4fafe6-bd80-46ac-b9fc-3814158757cc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:32.193684 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd4fafe6-bd80-46ac-b9fc-3814158757cc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:32.194108 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd4fafe6-bd80-46ac-b9fc-3814158757cc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:32.218982 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dd4fafe6-bd80-46ac-b9fc-3814158757cc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:28:32.294903 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dd4fafe6-bd80-46ac-b9fc-3814158757cc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 204 len: 0 microversion: 2.1 time: 0.114061 Aug 18 14:28:32.295428 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 203/405] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:28:32 2022] DELETE /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:28:32.304305 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e52e6b4c-7d33-4148-9765-7c7814bf2888 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:32.304917 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e52e6b4c-7d33-4148-9765-7c7814bf2888 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:32.311804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e52e6b4c-7d33-4148-9765-7c7814bf2888 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:32.312323 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e52e6b4c-7d33-4148-9765-7c7814bf2888 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:32.312762 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e52e6b4c-7d33-4148-9765-7c7814bf2888 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:32.313445 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e52e6b4c-7d33-4148-9765-7c7814bf2888 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:32.313904 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e52e6b4c-7d33-4148-9765-7c7814bf2888 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:32.314321 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e52e6b4c-7d33-4148-9765-7c7814bf2888 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:32.444207 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e52e6b4c-7d33-4148-9765-7c7814bf2888 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:32.451783 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e52e6b4c-7d33-4148-9765-7c7814bf2888 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1681 microversion: 2.1 time: 0.152008 Aug 18 14:28:32.452335 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 203/406] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:32 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:32.930179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0188d91a-3e6c-423c-b220-e07ada8f0449 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:32.930808 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0188d91a-3e6c-423c-b220-e07ada8f0449 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:32.936737 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0188d91a-3e6c-423c-b220-e07ada8f0449 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:32.937229 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0188d91a-3e6c-423c-b220-e07ada8f0449 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:32.937665 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0188d91a-3e6c-423c-b220-e07ada8f0449 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:32.938355 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0188d91a-3e6c-423c-b220-e07ada8f0449 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:32.938811 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0188d91a-3e6c-423c-b220-e07ada8f0449 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:32.939240 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0188d91a-3e6c-423c-b220-e07ada8f0449 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:33.073234 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0188d91a-3e6c-423c-b220-e07ada8f0449 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:33.082148 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0188d91a-3e6c-423c-b220-e07ada8f0449 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:33.083750 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0188d91a-3e6c-423c-b220-e07ada8f0449 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:33.085003 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0188d91a-3e6c-423c-b220-e07ada8f0449 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1720 microversion: 2.20 time: 0.159775 Aug 18 14:28:33.085597 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 204/407] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:32 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:33.103893 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-8e054cd5-b1bb-4121-a438-2bf2d621d5b2 req-7439d002-39a4-461b-8c19-3f3e0e0aed3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d09be0-5622-4167-859a-c81e38fc7218", "name": "network-vif-unplugged", "status": "completed", "tag": "ce6e4f0c-73f1-4b80-9e83-e467ad9ba266"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:28:33.114308 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-8e054cd5-b1bb-4121-a438-2bf2d621d5b2 req-7439d002-39a4-461b-8c19-3f3e0e0aed3a service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:33.114778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-8e054cd5-b1bb-4121-a438-2bf2d621d5b2 req-7439d002-39a4-461b-8c19-3f3e0e0aed3a service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:33.115424 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-8e054cd5-b1bb-4121-a438-2bf2d621d5b2 req-7439d002-39a4-461b-8c19-3f3e0e0aed3a service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:33.126416 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-8e054cd5-b1bb-4121-a438-2bf2d621d5b2 req-7439d002-39a4-461b-8c19-3f3e0e0aed3a service nova] Creating event network-vif-unplugged:ce6e4f0c-73f1-4b80-9e83-e467ad9ba266 for instance 95d09be0-5622-4167-859a-c81e38fc7218 on hv-cinder-85220 Aug 18 14:28:33.131583 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-8e054cd5-b1bb-4121-a438-2bf2d621d5b2 req-7439d002-39a4-461b-8c19-3f3e0e0aed3a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031799 Aug 18 14:28:33.132163 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 204/408] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:28:33.473880 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ba2b7bfc-cdfc-4431-abcb-cb5109268aa2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:33.474681 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ba2b7bfc-cdfc-4431-abcb-cb5109268aa2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:33.480959 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba2b7bfc-cdfc-4431-abcb-cb5109268aa2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:33.481447 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba2b7bfc-cdfc-4431-abcb-cb5109268aa2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:33.481887 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba2b7bfc-cdfc-4431-abcb-cb5109268aa2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:33.482580 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba2b7bfc-cdfc-4431-abcb-cb5109268aa2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:33.483034 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba2b7bfc-cdfc-4431-abcb-cb5109268aa2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:33.483494 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba2b7bfc-cdfc-4431-abcb-cb5109268aa2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:33.692835 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0bcd72f7-d4e0-457a-b4e4-cf8153d12d1c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:33.693535 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0bcd72f7-d4e0-457a-b4e4-cf8153d12d1c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:33.700170 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bcd72f7-d4e0-457a-b4e4-cf8153d12d1c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:33.700689 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bcd72f7-d4e0-457a-b4e4-cf8153d12d1c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:33.701120 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bcd72f7-d4e0-457a-b4e4-cf8153d12d1c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:33.701818 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bcd72f7-d4e0-457a-b4e4-cf8153d12d1c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:33.702269 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bcd72f7-d4e0-457a-b4e4-cf8153d12d1c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:33.702691 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bcd72f7-d4e0-457a-b4e4-cf8153d12d1c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:33.839452 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-0bcd72f7-d4e0-457a-b4e4-cf8153d12d1c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lazy-loading 'services' on Instance uuid f5986cc6-52c8-48ae-8cba-92b60e02d98e {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:28:33.845271 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ba2b7bfc-cdfc-4431-abcb-cb5109268aa2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:33.853797 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ba2b7bfc-cdfc-4431-abcb-cb5109268aa2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1681 microversion: 2.1 time: 0.384107 Aug 18 14:28:33.854451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 205/409] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:33 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1681 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:33.859462 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-da89b5f9-0f6b-490e-92c5-eec8824637ae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd6f466c-a23c-4dac-8f27-472d6d8f9da1"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:28:33.861731 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-da89b5f9-0f6b-490e-92c5-eec8824637ae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:33.868675 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da89b5f9-0f6b-490e-92c5-eec8824637ae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:33.869155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da89b5f9-0f6b-490e-92c5-eec8824637ae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:33.869589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da89b5f9-0f6b-490e-92c5-eec8824637ae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:33.870272 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da89b5f9-0f6b-490e-92c5-eec8824637ae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:33.870720 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da89b5f9-0f6b-490e-92c5-eec8824637ae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:33.871141 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da89b5f9-0f6b-490e-92c5-eec8824637ae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:33.957695 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0bcd72f7-d4e0-457a-b4e4-cf8153d12d1c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e/os-volume_attachments/e5a8bdf8-4878-4340-8a23-318043070186" status: 202 len: 0 microversion: 2.1 time: 0.270034 Aug 18 14:28:33.962222 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 205/410] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Aug 18 14:28:33 2022] DELETE /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e/os-volume_attachments/e5a8bdf8-4878-4340-8a23-318043070186 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:28:34.110529 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0cd4810d-29e6-4a4b-8359-2574c6e2460d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:34.111217 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0cd4810d-29e6-4a4b-8359-2574c6e2460d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:34.118665 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0cd4810d-29e6-4a4b-8359-2574c6e2460d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:34.119142 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0cd4810d-29e6-4a4b-8359-2574c6e2460d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:34.119601 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0cd4810d-29e6-4a4b-8359-2574c6e2460d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:34.120279 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0cd4810d-29e6-4a4b-8359-2574c6e2460d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:34.120723 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0cd4810d-29e6-4a4b-8359-2574c6e2460d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:34.121142 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0cd4810d-29e6-4a4b-8359-2574c6e2460d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:34.256751 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0cd4810d-29e6-4a4b-8359-2574c6e2460d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:34.264815 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0cd4810d-29e6-4a4b-8359-2574c6e2460d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:34.266311 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0cd4810d-29e6-4a4b-8359-2574c6e2460d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:34.267486 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0cd4810d-29e6-4a4b-8359-2574c6e2460d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1720 microversion: 2.20 time: 0.161157 Aug 18 14:28:34.268096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 206/411] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:34 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:28:34.875921 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e3e593f1-63a5-4b85-ad69-b8938d73cff7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:34.876559 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e3e593f1-63a5-4b85-ad69-b8938d73cff7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:34.883391 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3e593f1-63a5-4b85-ad69-b8938d73cff7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:34.884116 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3e593f1-63a5-4b85-ad69-b8938d73cff7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:34.884484 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3e593f1-63a5-4b85-ad69-b8938d73cff7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:34.885377 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3e593f1-63a5-4b85-ad69-b8938d73cff7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:34.885851 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3e593f1-63a5-4b85-ad69-b8938d73cff7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:34.886285 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3e593f1-63a5-4b85-ad69-b8938d73cff7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:35.024053 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e3e593f1-63a5-4b85-ad69-b8938d73cff7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:35.026545 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:35.037278 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e3e593f1-63a5-4b85-ad69-b8938d73cff7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1681 microversion: 2.1 time: 0.165484 Aug 18 14:28:35.038232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 207/412] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:34 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:28:35.198003 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-da89b5f9-0f6b-490e-92c5-eec8824637ae tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "POST /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.342295 Aug 18 14:28:35.198611 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 206/413] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:28:33 2022] POST /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-volume_attachments => generated 194 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:28:35.292677 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b969df7e-2c2e-468a-ac2d-03411ed6dae8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:35.293376 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b969df7e-2c2e-468a-ac2d-03411ed6dae8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:35.299863 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b969df7e-2c2e-468a-ac2d-03411ed6dae8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:35.300485 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b969df7e-2c2e-468a-ac2d-03411ed6dae8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:35.300936 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b969df7e-2c2e-468a-ac2d-03411ed6dae8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:35.301627 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b969df7e-2c2e-468a-ac2d-03411ed6dae8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:35.302108 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b969df7e-2c2e-468a-ac2d-03411ed6dae8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:35.302528 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b969df7e-2c2e-468a-ac2d-03411ed6dae8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:35.436206 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b969df7e-2c2e-468a-ac2d-03411ed6dae8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:35.444397 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b969df7e-2c2e-468a-ac2d-03411ed6dae8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:35.446618 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b969df7e-2c2e-468a-ac2d-03411ed6dae8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:35.448086 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b969df7e-2c2e-468a-ac2d-03411ed6dae8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1723 microversion: 2.20 time: 0.159798 Aug 18 14:28:35.448636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 208/414] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:35 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:35.475051 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8c91f34a-1197-4a66-90cd-b333e2ff1f43 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dd7c1af-358c-462c-a862-92b3cb4cc3ba"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:28:35.477803 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8c91f34a-1197-4a66-90cd-b333e2ff1f43 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:35.486679 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c91f34a-1197-4a66-90cd-b333e2ff1f43 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:35.487194 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c91f34a-1197-4a66-90cd-b333e2ff1f43 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:35.487712 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c91f34a-1197-4a66-90cd-b333e2ff1f43 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:35.488483 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c91f34a-1197-4a66-90cd-b333e2ff1f43 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:35.488936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c91f34a-1197-4a66-90cd-b333e2ff1f43 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:35.489360 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c91f34a-1197-4a66-90cd-b333e2ff1f43 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:35.814977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8c91f34a-1197-4a66-90cd-b333e2ff1f43 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "POST /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.346826 Aug 18 14:28:35.817459 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 207/415] 10.222.0.39 () {62 vars in 1364 bytes} [Thu Aug 18 14:28:35 2022] POST /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/os-volume_attachments => generated 188 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:28:35.945248 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-03fab123-cb39-4971-a4d8-a56ab04c0a67 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:28:35.946075 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-03fab123-cb39-4971-a4d8-a56ab04c0a67 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:35.952841 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03fab123-cb39-4971-a4d8-a56ab04c0a67 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:35.953828 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03fab123-cb39-4971-a4d8-a56ab04c0a67 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:35.954829 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03fab123-cb39-4971-a4d8-a56ab04c0a67 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:35.956016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03fab123-cb39-4971-a4d8-a56ab04c0a67 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:35.958644 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03fab123-cb39-4971-a4d8-a56ab04c0a67 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:35.959550 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03fab123-cb39-4971-a4d8-a56ab04c0a67 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:36.023162 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-03fab123-cb39-4971-a4d8-a56ab04c0a67 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120538) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 14:28:36.059730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-46de9120-7907-4691-853e-7b14b08f3ba6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:36.060348 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-46de9120-7907-4691-853e-7b14b08f3ba6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:36.069580 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46de9120-7907-4691-853e-7b14b08f3ba6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:36.070074 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46de9120-7907-4691-853e-7b14b08f3ba6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:36.071301 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46de9120-7907-4691-853e-7b14b08f3ba6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:36.072165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46de9120-7907-4691-853e-7b14b08f3ba6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:36.073046 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46de9120-7907-4691-853e-7b14b08f3ba6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:36.073188 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46de9120-7907-4691-853e-7b14b08f3ba6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:36.103979 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-03fab123-cb39-4971-a4d8-a56ab04c0a67 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "POST /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/action" status: 202 len: 0 microversion: 2.20 time: 0.163046 Aug 18 14:28:36.105083 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 209/416] 10.222.0.39 () {62 vars in 1319 bytes} [Thu Aug 18 14:28:35 2022] POST /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:28:36.117645 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9a6b1fa4-8f3d-4695-bf2e-1a84fa5dbce7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:36.118263 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9a6b1fa4-8f3d-4695-bf2e-1a84fa5dbce7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:36.126235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a6b1fa4-8f3d-4695-bf2e-1a84fa5dbce7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:36.126737 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a6b1fa4-8f3d-4695-bf2e-1a84fa5dbce7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:36.127291 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a6b1fa4-8f3d-4695-bf2e-1a84fa5dbce7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:36.128045 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a6b1fa4-8f3d-4695-bf2e-1a84fa5dbce7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:36.129148 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a6b1fa4-8f3d-4695-bf2e-1a84fa5dbce7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:36.129578 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a6b1fa4-8f3d-4695-bf2e-1a84fa5dbce7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:36.197240 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-46de9120-7907-4691-853e-7b14b08f3ba6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:36.210989 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-46de9120-7907-4691-853e-7b14b08f3ba6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1613 microversion: 2.1 time: 0.153888 Aug 18 14:28:36.210989 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 208/417] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:36 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1613 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:28:36.222673 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b20bafb5-aab2-4dc3-a552-3ae7df5c6ee7 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:36.223533 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b20bafb5-aab2-4dc3-a552-3ae7df5c6ee7 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:36.230230 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b20bafb5-aab2-4dc3-a552-3ae7df5c6ee7 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:36.231005 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b20bafb5-aab2-4dc3-a552-3ae7df5c6ee7 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:36.232144 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b20bafb5-aab2-4dc3-a552-3ae7df5c6ee7 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:36.233024 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b20bafb5-aab2-4dc3-a552-3ae7df5c6ee7 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:36.233926 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b20bafb5-aab2-4dc3-a552-3ae7df5c6ee7 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:36.234806 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b20bafb5-aab2-4dc3-a552-3ae7df5c6ee7 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:36.285958 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b20bafb5-aab2-4dc3-a552-3ae7df5c6ee7 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:28:36.313587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9a6b1fa4-8f3d-4695-bf2e-1a84fa5dbce7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:36.324076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9a6b1fa4-8f3d-4695-bf2e-1a84fa5dbce7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:36.326056 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9a6b1fa4-8f3d-4695-bf2e-1a84fa5dbce7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:36.327478 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9a6b1fa4-8f3d-4695-bf2e-1a84fa5dbce7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1749 microversion: 2.20 time: 0.214810 Aug 18 14:28:36.328172 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:36.328519 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 210/418] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:36 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1749 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:36.434412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b20bafb5-aab2-4dc3-a552-3ae7df5c6ee7 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 204 len: 0 microversion: 2.1 time: 0.222371 Aug 18 14:28:36.434592 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 209/419] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:28:36 2022] DELETE /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:28:36.443525 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-92dc2e3d-7bd0-419f-bd8c-5254730677af tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:36.444155 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-92dc2e3d-7bd0-419f-bd8c-5254730677af tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:36.453012 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92dc2e3d-7bd0-419f-bd8c-5254730677af tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:36.453504 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92dc2e3d-7bd0-419f-bd8c-5254730677af tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:36.453952 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92dc2e3d-7bd0-419f-bd8c-5254730677af tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:36.454660 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92dc2e3d-7bd0-419f-bd8c-5254730677af tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:36.455122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92dc2e3d-7bd0-419f-bd8c-5254730677af tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:36.455582 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92dc2e3d-7bd0-419f-bd8c-5254730677af tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:36.612398 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-b31c76a9-0768-42d0-83f4-8b6deda9ac1a req-251ec417-088c-46b9-b7a8-9f5a524e43e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7926083-e26a-4fa9-bd23-73d13c892da4", "name": "network-vif-deleted", "tag": "68644b48-fcf3-4a55-b0f0-c2ff0a586bd6"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:28:36.626646 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b31c76a9-0768-42d0-83f4-8b6deda9ac1a req-251ec417-088c-46b9-b7a8-9f5a524e43e0 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:36.627397 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b31c76a9-0768-42d0-83f4-8b6deda9ac1a req-251ec417-088c-46b9-b7a8-9f5a524e43e0 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:36.627833 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b31c76a9-0768-42d0-83f4-8b6deda9ac1a req-251ec417-088c-46b9-b7a8-9f5a524e43e0 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:36.642796 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-b31c76a9-0768-42d0-83f4-8b6deda9ac1a req-251ec417-088c-46b9-b7a8-9f5a524e43e0 service nova] Creating event network-vif-deleted:68644b48-fcf3-4a55-b0f0-c2ff0a586bd6 for instance b7926083-e26a-4fa9-bd23-73d13c892da4 on hv-cinder-85220 Aug 18 14:28:36.648221 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-92dc2e3d-7bd0-419f-bd8c-5254730677af tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:36.650232 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-b31c76a9-0768-42d0-83f4-8b6deda9ac1a req-251ec417-088c-46b9-b7a8-9f5a524e43e0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045194 Aug 18 14:28:36.654600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 210/420] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:28:36.658240 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-92dc2e3d-7bd0-419f-bd8c-5254730677af tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1512 microversion: 2.1 time: 0.218734 Aug 18 14:28:36.659106 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 211/421] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:36 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:37.239305 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cb639341-4806-48e8-b7e8-b4bd19fe0c11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:37.240623 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cb639341-4806-48e8-b7e8-b4bd19fe0c11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:37.248677 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb639341-4806-48e8-b7e8-b4bd19fe0c11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:37.249380 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb639341-4806-48e8-b7e8-b4bd19fe0c11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:37.250059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb639341-4806-48e8-b7e8-b4bd19fe0c11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:37.250909 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb639341-4806-48e8-b7e8-b4bd19fe0c11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:37.251553 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb639341-4806-48e8-b7e8-b4bd19fe0c11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:37.252118 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb639341-4806-48e8-b7e8-b4bd19fe0c11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:37.354771 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-66e8caa3-c403-4042-835b-23567f02b48b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:37.355429 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-66e8caa3-c403-4042-835b-23567f02b48b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:37.361958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66e8caa3-c403-4042-835b-23567f02b48b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:37.362446 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66e8caa3-c403-4042-835b-23567f02b48b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:37.364597 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cb639341-4806-48e8-b7e8-b4bd19fe0c11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:37.371611 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66e8caa3-c403-4042-835b-23567f02b48b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:37.372465 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66e8caa3-c403-4042-835b-23567f02b48b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:37.373445 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cb639341-4806-48e8-b7e8-b4bd19fe0c11 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1613 microversion: 2.1 time: 0.139242 Aug 18 14:28:37.373570 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66e8caa3-c403-4042-835b-23567f02b48b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:37.374028 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66e8caa3-c403-4042-835b-23567f02b48b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:37.389834 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 211/422] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:37 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1613 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:37.555837 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-66e8caa3-c403-4042-835b-23567f02b48b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:37.565082 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-66e8caa3-c403-4042-835b-23567f02b48b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:37.567011 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-66e8caa3-c403-4042-835b-23567f02b48b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:37.568506 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-66e8caa3-c403-4042-835b-23567f02b48b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1749 microversion: 2.20 time: 0.220507 Aug 18 14:28:37.569447 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 212/423] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:37 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1749 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:37.679757 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-374419a6-496e-40a2-986a-8f6219a7ceb5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:37.680509 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-374419a6-496e-40a2-986a-8f6219a7ceb5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:37.686932 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-374419a6-496e-40a2-986a-8f6219a7ceb5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:37.687803 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-374419a6-496e-40a2-986a-8f6219a7ceb5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:37.688319 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-374419a6-496e-40a2-986a-8f6219a7ceb5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:37.689198 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-374419a6-496e-40a2-986a-8f6219a7ceb5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:37.689744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-374419a6-496e-40a2-986a-8f6219a7ceb5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:37.690239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-374419a6-496e-40a2-986a-8f6219a7ceb5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:37.847893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-374419a6-496e-40a2-986a-8f6219a7ceb5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:37.862037 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-374419a6-496e-40a2-986a-8f6219a7ceb5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1512 microversion: 2.1 time: 0.185681 Aug 18 14:28:37.864487 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 212/424] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:37 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1512 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:38.394112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:38.395505 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:38.402909 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:38.403636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:38.404292 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:38.405260 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:38.405884 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:38.406640 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:38.444460 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:38.445237 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:38.445690 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:38.446151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lazy-loading 'fault' on Instance uuid b7926083-e26a-4fa9-bd23-73d13c892da4 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:28:38.536617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:38.544559 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b77bdf63-b992-4ec9-8aa7-bbcff07fac45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 200 len: 1332 microversion: 2.1 time: 0.154212 Aug 18 14:28:38.545333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 213/425] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:38 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 1332 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:38.591606 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f10888b4-07f9-4909-89ea-e266d75a6ed2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:38.592209 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f10888b4-07f9-4909-89ea-e266d75a6ed2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:38.599551 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f10888b4-07f9-4909-89ea-e266d75a6ed2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:38.600037 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f10888b4-07f9-4909-89ea-e266d75a6ed2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:38.600477 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f10888b4-07f9-4909-89ea-e266d75a6ed2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:38.601175 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f10888b4-07f9-4909-89ea-e266d75a6ed2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:38.601621 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f10888b4-07f9-4909-89ea-e266d75a6ed2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:38.602039 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f10888b4-07f9-4909-89ea-e266d75a6ed2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:38.810180 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f10888b4-07f9-4909-89ea-e266d75a6ed2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:38.820262 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f10888b4-07f9-4909-89ea-e266d75a6ed2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:38.822162 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f10888b4-07f9-4909-89ea-e266d75a6ed2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:38.823610 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f10888b4-07f9-4909-89ea-e266d75a6ed2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1751 microversion: 2.20 time: 0.236131 Aug 18 14:28:38.824730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 213/426] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:38 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1751 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:28:38.889741 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-85133436-a166-42aa-b552-1b101c3e1862 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:38.890270 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-85133436-a166-42aa-b552-1b101c3e1862 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:38.897192 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85133436-a166-42aa-b552-1b101c3e1862 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:38.897900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85133436-a166-42aa-b552-1b101c3e1862 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:38.898356 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85133436-a166-42aa-b552-1b101c3e1862 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:38.899083 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85133436-a166-42aa-b552-1b101c3e1862 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:38.899577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85133436-a166-42aa-b552-1b101c3e1862 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:38.900019 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85133436-a166-42aa-b552-1b101c3e1862 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:38.920375 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-cf15a5c4-4232-416c-8f3f-a86e7b8348a3 req-e0aca9b0-1caf-4388-b677-650fe6d4e4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5986cc6-52c8-48ae-8cba-92b60e02d98e", "name": "network-vif-deleted", "tag": "2208a5c4-fcbe-421c-ba27-a7c0acca16a3"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:28:38.930582 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cf15a5c4-4232-416c-8f3f-a86e7b8348a3 req-e0aca9b0-1caf-4388-b677-650fe6d4e4c2 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:38.931060 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cf15a5c4-4232-416c-8f3f-a86e7b8348a3 req-e0aca9b0-1caf-4388-b677-650fe6d4e4c2 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:38.931511 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cf15a5c4-4232-416c-8f3f-a86e7b8348a3 req-e0aca9b0-1caf-4388-b677-650fe6d4e4c2 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:38.952496 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-cf15a5c4-4232-416c-8f3f-a86e7b8348a3 req-e0aca9b0-1caf-4388-b677-650fe6d4e4c2 service nova] Creating event network-vif-deleted:2208a5c4-fcbe-421c-ba27-a7c0acca16a3 for instance f5986cc6-52c8-48ae-8cba-92b60e02d98e on hv-cinder-85220 Aug 18 14:28:38.958991 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-cf15a5c4-4232-416c-8f3f-a86e7b8348a3 req-e0aca9b0-1caf-4388-b677-650fe6d4e4c2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042305 Aug 18 14:28:38.960069 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 214/427] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:28:38.990111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-85133436-a166-42aa-b552-1b101c3e1862 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:39.004365 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-85133436-a166-42aa-b552-1b101c3e1862 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 200 len: 1470 microversion: 2.1 time: 0.118052 Aug 18 14:28:39.005307 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 214/428] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:38 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 1470 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:39.566578 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5a058152-8605-41cc-94bb-fd806a251065 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:39.567285 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5a058152-8605-41cc-94bb-fd806a251065 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:39.573479 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a058152-8605-41cc-94bb-fd806a251065 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:39.573955 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a058152-8605-41cc-94bb-fd806a251065 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:39.574389 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a058152-8605-41cc-94bb-fd806a251065 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:39.575069 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a058152-8605-41cc-94bb-fd806a251065 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:39.575551 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a058152-8605-41cc-94bb-fd806a251065 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:39.575975 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a058152-8605-41cc-94bb-fd806a251065 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:39.589192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-5a058152-8605-41cc-94bb-fd806a251065 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5a058152-8605-41cc-94bb-fd806a251065 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 HTTP/1.1 Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:28:39.590812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:28:39.592852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:28:39.592852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:28:39.592852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:28:39.592852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:28:39.592852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:28:39.592852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:28:39.592852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:28:39.592852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:28:39.592852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:28:39.592852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:28:39.592852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:28:39.592852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': 'b7926083-e26a-4fa9-bd23-73d13c892da4'} Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:28:39.593990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:28:39.595419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:28:39.596704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5a058152-8605-41cc-94bb-fd806a251065 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 404 to user: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:28:39.596704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5a058152-8605-41cc-94bb-fd806a251065 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 404 len: 111 microversion: 2.1 time: 0.029980 Aug 18 14:28:39.596704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 215/429] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:39 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:28:39.602777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-66167c50-5333-4a9f-a7e3-1d077011ef37 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '.version_select at 0x7fb62215e310>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:39.623432 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-66167c50-5333-4a9f-a7e3-1d077011ef37 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071497103" status: 202 len: 0 microversion: 2.1 time: 0.025334 Aug 18 14:28:39.623970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 215/430] 10.222.0.39 () {58 vars in 1221 bytes} [Thu Aug 18 14:28:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071497103 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:28:39.848808 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4d9d96ee-bc9a-4864-be03-d8300e69e249 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:39.849336 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4d9d96ee-bc9a-4864-be03-d8300e69e249 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:39.855736 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d9d96ee-bc9a-4864-be03-d8300e69e249 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:39.856219 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d9d96ee-bc9a-4864-be03-d8300e69e249 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:39.856655 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d9d96ee-bc9a-4864-be03-d8300e69e249 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:39.857350 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d9d96ee-bc9a-4864-be03-d8300e69e249 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:39.857807 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d9d96ee-bc9a-4864-be03-d8300e69e249 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:39.858229 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d9d96ee-bc9a-4864-be03-d8300e69e249 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:40.027061 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b4cbc601-0873-4dba-9637-c25b28773464 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:40.027790 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b4cbc601-0873-4dba-9637-c25b28773464 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: f5986cc6-52c8-48ae-8cba-92b60e02d98e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:40.034534 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4cbc601-0873-4dba-9637-c25b28773464 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:40.036078 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4cbc601-0873-4dba-9637-c25b28773464 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:40.036520 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4cbc601-0873-4dba-9637-c25b28773464 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:40.037220 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4cbc601-0873-4dba-9637-c25b28773464 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:40.037672 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4cbc601-0873-4dba-9637-c25b28773464 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:40.038129 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4cbc601-0873-4dba-9637-c25b28773464 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:40.051642 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-b4cbc601-0873-4dba-9637-c25b28773464 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] HTTP exception thrown: Instance f5986cc6-52c8-48ae-8cba-92b60e02d98e could not be found. Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b4cbc601-0873-4dba-9637-c25b28773464 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Request method failure captured: Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e HTTP/1.1 Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kxMGzs2kWBWugVB_XPrDja8XKldPKfCaxjBLiF8AzdbFon9EhlUGerI0-zlfx1cIllipRTaveKfKIiQPWaZYCt5iTW8qLGaoO1qqC_jcibeYJ9fX2u6R_95aZHGPQJP0biIGbWgllBuf4HCIr38AJuNwNmzq2My0RUOmv29JDzwiA4 Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 4d1de27922464f9291f0999378307c06 Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1191740297 Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:28:40.053316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:28:40.054830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4d1de27922464f9291f0999378307c06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4d1de27922464f9291f0999378307c06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4d1de27922464f9291f0999378307c06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4d1de27922464f9291f0999378307c06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:28:40.054830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesSnapshotTestJSON-1191740297 Aug 18 14:28:40.054830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 4d1de27922464f9291f0999378307c06 Aug 18 14:28:40.054830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1191740297 Aug 18 14:28:40.054830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesSnapshotTestJSON-1191740297-project Aug 18 14:28:40.054830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:28:40.054830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:28:40.054830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 677239d934c04e50b024a001c0152e57 Aug 18 14:28:40.054830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesSnapshotTestJSON-1191740297-project Aug 18 14:28:40.054830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:28:40.054830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance f5986cc6-52c8-48ae-8cba-92b60e02d98e could not be found. Aug 18 14:28:40.054830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': 'f5986cc6-52c8-48ae-8cba-92b60e02d98e'} Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5986cc6-52c8-48ae-8cba-92b60e02d98e could not be found. Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:28:40.055804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5986cc6-52c8-48ae-8cba-92b60e02d98e could not be found. Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5986cc6-52c8-48ae-8cba-92b60e02d98e could not be found. Aug 18 14:28:40.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:28:40.058562 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b4cbc601-0873-4dba-9637-c25b28773464 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Returning 404 to user: Instance f5986cc6-52c8-48ae-8cba-92b60e02d98e could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:28:40.058562 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b4cbc601-0873-4dba-9637-c25b28773464 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e" status: 404 len: 111 microversion: 2.1 time: 0.031935 Aug 18 14:28:40.058562 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 216/431] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:40 2022] GET /compute/v2.1/servers/f5986cc6-52c8-48ae-8cba-92b60e02d98e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:28:40.080312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4d9d96ee-bc9a-4864-be03-d8300e69e249 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:40.090184 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4d9d96ee-bc9a-4864-be03-d8300e69e249 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:40.091702 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4d9d96ee-bc9a-4864-be03-d8300e69e249 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:40.093256 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4d9d96ee-bc9a-4864-be03-d8300e69e249 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1751 microversion: 2.20 time: 0.248901 Aug 18 14:28:40.093990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 216/432] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:39 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1751 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:40.400169 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f73ad8a7-2c4b-4312-8e5d-4bc38f9e6075 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:40.400594 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f73ad8a7-2c4b-4312-8e5d-4bc38f9e6075 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:40.407539 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f73ad8a7-2c4b-4312-8e5d-4bc38f9e6075 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:40.408021 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f73ad8a7-2c4b-4312-8e5d-4bc38f9e6075 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:40.408461 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f73ad8a7-2c4b-4312-8e5d-4bc38f9e6075 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:40.409148 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f73ad8a7-2c4b-4312-8e5d-4bc38f9e6075 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:40.409873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f73ad8a7-2c4b-4312-8e5d-4bc38f9e6075 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:40.410292 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f73ad8a7-2c4b-4312-8e5d-4bc38f9e6075 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:40.490198 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-f73ad8a7-2c4b-4312-8e5d-4bc38f9e6075 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lazy-loading 'services' on Instance uuid ed05a0ad-3aad-4113-b8b3-8daa97e04f2f {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:28:40.563012 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f73ad8a7-2c4b-4312-8e5d-4bc38f9e6075 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments/8487ce6f-1020-416c-a636-52d38f01b805" status: 202 len: 0 microversion: 2.1 time: 0.166778 Aug 18 14:28:40.563631 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 217/433] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Aug 18 14:28:40 2022] DELETE /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments/8487ce6f-1020-416c-a636-52d38f01b805 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:28:40.573363 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-055f863d-2754-4b42-badd-eec615a33b4a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:40.576006 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-055f863d-2754-4b42-badd-eec615a33b4a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:40.583583 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-055f863d-2754-4b42-badd-eec615a33b4a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:40.584843 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-055f863d-2754-4b42-badd-eec615a33b4a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:40.584843 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-055f863d-2754-4b42-badd-eec615a33b4a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:40.585181 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-055f863d-2754-4b42-badd-eec615a33b4a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:40.585623 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-055f863d-2754-4b42-badd-eec615a33b4a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:40.586039 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-055f863d-2754-4b42-badd-eec615a33b4a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:40.617574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-055f863d-2754-4b42-badd-eec615a33b4a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048408 Aug 18 14:28:40.618150 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 217/434] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:28:40 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:28:41.118163 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-49470dca-5750-4611-a856-fecc3c7b09f1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:41.118887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-49470dca-5750-4611-a856-fecc3c7b09f1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:41.125084 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49470dca-5750-4611-a856-fecc3c7b09f1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:41.125565 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49470dca-5750-4611-a856-fecc3c7b09f1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:41.125997 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49470dca-5750-4611-a856-fecc3c7b09f1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:41.126677 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49470dca-5750-4611-a856-fecc3c7b09f1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:41.127128 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49470dca-5750-4611-a856-fecc3c7b09f1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:41.127590 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49470dca-5750-4611-a856-fecc3c7b09f1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:41.258711 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-49470dca-5750-4611-a856-fecc3c7b09f1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:41.267410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-49470dca-5750-4611-a856-fecc3c7b09f1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:41.269908 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-49470dca-5750-4611-a856-fecc3c7b09f1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:41.271081 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-49470dca-5750-4611-a856-fecc3c7b09f1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1751 microversion: 2.20 time: 0.158347 Aug 18 14:28:41.271681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 218/435] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:41 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:41.630412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8d297c25-5095-49f2-8f73-676f836c730e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:41.632696 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8d297c25-5095-49f2-8f73-676f836c730e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:41.639236 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d297c25-5095-49f2-8f73-676f836c730e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:41.639762 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d297c25-5095-49f2-8f73-676f836c730e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:41.640205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d297c25-5095-49f2-8f73-676f836c730e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:41.640902 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d297c25-5095-49f2-8f73-676f836c730e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:41.641364 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d297c25-5095-49f2-8f73-676f836c730e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:41.641791 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d297c25-5095-49f2-8f73-676f836c730e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:41.671496 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8d297c25-5095-49f2-8f73-676f836c730e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045659 Aug 18 14:28:41.672063 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 218/436] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:28:41 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:28:42.294778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-72cb2d94-807d-49fe-b077-7a8f1216bb12 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:42.295397 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-72cb2d94-807d-49fe-b077-7a8f1216bb12 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:42.302659 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72cb2d94-807d-49fe-b077-7a8f1216bb12 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:42.303135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72cb2d94-807d-49fe-b077-7a8f1216bb12 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:42.303688 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72cb2d94-807d-49fe-b077-7a8f1216bb12 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:42.304855 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72cb2d94-807d-49fe-b077-7a8f1216bb12 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:42.305308 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72cb2d94-807d-49fe-b077-7a8f1216bb12 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:42.305726 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72cb2d94-807d-49fe-b077-7a8f1216bb12 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:42.442399 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-72cb2d94-807d-49fe-b077-7a8f1216bb12 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:42.451310 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-72cb2d94-807d-49fe-b077-7a8f1216bb12 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:42.452827 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-72cb2d94-807d-49fe-b077-7a8f1216bb12 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:42.453981 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-72cb2d94-807d-49fe-b077-7a8f1216bb12 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1751 microversion: 2.20 time: 0.163038 Aug 18 14:28:42.454539 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 219/437] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:42 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:42.684080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7096fbc5-f8d4-4748-aaef-c47b0b312cfc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:42.686137 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7096fbc5-f8d4-4748-aaef-c47b0b312cfc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:42.693535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7096fbc5-f8d4-4748-aaef-c47b0b312cfc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:42.694020 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7096fbc5-f8d4-4748-aaef-c47b0b312cfc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:42.694460 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7096fbc5-f8d4-4748-aaef-c47b0b312cfc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:42.695214 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7096fbc5-f8d4-4748-aaef-c47b0b312cfc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:42.695622 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7096fbc5-f8d4-4748-aaef-c47b0b312cfc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:42.696046 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7096fbc5-f8d4-4748-aaef-c47b0b312cfc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:42.726784 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7096fbc5-f8d4-4748-aaef-c47b0b312cfc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046632 Aug 18 14:28:42.727346 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 219/438] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:28:42 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:28:43.478671 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6eded82f-05bb-4f43-bcd9-e544ad629a2f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:43.479906 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6eded82f-05bb-4f43-bcd9-e544ad629a2f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:43.486164 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6eded82f-05bb-4f43-bcd9-e544ad629a2f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:43.486648 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6eded82f-05bb-4f43-bcd9-e544ad629a2f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:43.487079 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6eded82f-05bb-4f43-bcd9-e544ad629a2f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:43.488068 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6eded82f-05bb-4f43-bcd9-e544ad629a2f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:43.488865 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6eded82f-05bb-4f43-bcd9-e544ad629a2f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:43.489449 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6eded82f-05bb-4f43-bcd9-e544ad629a2f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:43.625447 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6eded82f-05bb-4f43-bcd9-e544ad629a2f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:43.634231 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6eded82f-05bb-4f43-bcd9-e544ad629a2f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:43.635864 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6eded82f-05bb-4f43-bcd9-e544ad629a2f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:43.637054 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6eded82f-05bb-4f43-bcd9-e544ad629a2f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1751 microversion: 2.20 time: 0.162339 Aug 18 14:28:43.637607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 220/439] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:43 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:43.738653 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6f907e87-7121-46e3-b6ac-43251967582d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:43.741093 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6f907e87-7121-46e3-b6ac-43251967582d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:43.747795 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f907e87-7121-46e3-b6ac-43251967582d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:43.748284 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f907e87-7121-46e3-b6ac-43251967582d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:43.748720 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f907e87-7121-46e3-b6ac-43251967582d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:43.749412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f907e87-7121-46e3-b6ac-43251967582d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:43.749866 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f907e87-7121-46e3-b6ac-43251967582d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:43.750289 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f907e87-7121-46e3-b6ac-43251967582d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:43.780519 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6f907e87-7121-46e3-b6ac-43251967582d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046057 Aug 18 14:28:43.781092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 220/440] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:28:43 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:28:44.662840 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-87661164-e51d-4d5e-8b1f-fe2662633995 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:44.663803 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-87661164-e51d-4d5e-8b1f-fe2662633995 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:44.671283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-87661164-e51d-4d5e-8b1f-fe2662633995 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:44.671961 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-87661164-e51d-4d5e-8b1f-fe2662633995 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:44.672504 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-87661164-e51d-4d5e-8b1f-fe2662633995 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:44.673374 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-87661164-e51d-4d5e-8b1f-fe2662633995 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:44.673951 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-87661164-e51d-4d5e-8b1f-fe2662633995 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:44.674423 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-87661164-e51d-4d5e-8b1f-fe2662633995 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:44.794604 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ee245b56-7560-4d4f-bd0e-8b6fb41f8880 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:44.797939 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ee245b56-7560-4d4f-bd0e-8b6fb41f8880 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:44.829514 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee245b56-7560-4d4f-bd0e-8b6fb41f8880 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:44.830251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee245b56-7560-4d4f-bd0e-8b6fb41f8880 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:44.830919 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee245b56-7560-4d4f-bd0e-8b6fb41f8880 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:44.831885 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee245b56-7560-4d4f-bd0e-8b6fb41f8880 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:44.832691 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee245b56-7560-4d4f-bd0e-8b6fb41f8880 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:44.833336 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee245b56-7560-4d4f-bd0e-8b6fb41f8880 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:44.853539 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-87661164-e51d-4d5e-8b1f-fe2662633995 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:44.864630 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-87661164-e51d-4d5e-8b1f-fe2662633995 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:44.866861 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-87661164-e51d-4d5e-8b1f-fe2662633995 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:44.868193 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-87661164-e51d-4d5e-8b1f-fe2662633995 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1751 microversion: 2.20 time: 0.210829 Aug 18 14:28:44.868814 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ee245b56-7560-4d4f-bd0e-8b6fb41f8880 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079258 Aug 18 14:28:44.869511 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 221/441] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:44 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:44.871753 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 221/442] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:28:44 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:28:44.964027 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7e52d3b8-379b-49d8-9512-af1ec99909d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:28:44.966293 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7e52d3b8-379b-49d8-9512-af1ec99909d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:44.973327 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e52d3b8-379b-49d8-9512-af1ec99909d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:44.973826 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e52d3b8-379b-49d8-9512-af1ec99909d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:44.974308 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e52d3b8-379b-49d8-9512-af1ec99909d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:44.975011 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e52d3b8-379b-49d8-9512-af1ec99909d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:44.975516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e52d3b8-379b-49d8-9512-af1ec99909d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:44.975951 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e52d3b8-379b-49d8-9512-af1ec99909d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:44.998901 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-7e52d3b8-379b-49d8-9512-af1ec99909d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lazy-loading 'flavor' on Instance uuid 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:28:45.098729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:45.128709 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7e52d3b8-379b-49d8-9512-af1ec99909d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "POST /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/action" status: 200 len: 32 microversion: 2.1 time: 0.168575 Aug 18 14:28:45.129307 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 222/443] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:28:44 2022] POST /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:28:45.139624 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab0097a5-8062-4705-90aa-15f4a34efce8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:45.140247 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab0097a5-8062-4705-90aa-15f4a34efce8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:45.146875 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab0097a5-8062-4705-90aa-15f4a34efce8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:45.147354 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab0097a5-8062-4705-90aa-15f4a34efce8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:45.147814 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab0097a5-8062-4705-90aa-15f4a34efce8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:45.148499 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab0097a5-8062-4705-90aa-15f4a34efce8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:45.148952 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab0097a5-8062-4705-90aa-15f4a34efce8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:45.149374 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab0097a5-8062-4705-90aa-15f4a34efce8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:45.282114 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ab0097a5-8062-4705-90aa-15f4a34efce8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:45.290906 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab0097a5-8062-4705-90aa-15f4a34efce8 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.155240 Aug 18 14:28:45.291516 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 222/444] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:45 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:45.884349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-921be141-d90c-4678-ac2f-20d928542b42 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:45.886644 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-921be141-d90c-4678-ac2f-20d928542b42 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:45.892924 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-921be141-d90c-4678-ac2f-20d928542b42 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:45.893085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a8fdb6d2-fdf0-4166-9ad1-9b07ecdc91f9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:45.894023 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-921be141-d90c-4678-ac2f-20d928542b42 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:45.894222 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a8fdb6d2-fdf0-4166-9ad1-9b07ecdc91f9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:45.894397 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-921be141-d90c-4678-ac2f-20d928542b42 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:45.895095 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-921be141-d90c-4678-ac2f-20d928542b42 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:45.895590 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-921be141-d90c-4678-ac2f-20d928542b42 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:45.896015 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-921be141-d90c-4678-ac2f-20d928542b42 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:45.901938 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a8fdb6d2-fdf0-4166-9ad1-9b07ecdc91f9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:45.902770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a8fdb6d2-fdf0-4166-9ad1-9b07ecdc91f9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:45.903403 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a8fdb6d2-fdf0-4166-9ad1-9b07ecdc91f9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:45.904306 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a8fdb6d2-fdf0-4166-9ad1-9b07ecdc91f9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:45.904895 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a8fdb6d2-fdf0-4166-9ad1-9b07ecdc91f9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:45.905365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a8fdb6d2-fdf0-4166-9ad1-9b07ecdc91f9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:45.927198 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-921be141-d90c-4678-ac2f-20d928542b42 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047681 Aug 18 14:28:45.927786 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 223/445] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:28:45 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:28:46.042015 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a8fdb6d2-fdf0-4166-9ad1-9b07ecdc91f9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:46.051115 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a8fdb6d2-fdf0-4166-9ad1-9b07ecdc91f9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:46.052645 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a8fdb6d2-fdf0-4166-9ad1-9b07ecdc91f9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:46.053791 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a8fdb6d2-fdf0-4166-9ad1-9b07ecdc91f9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.164632 Aug 18 14:28:46.054339 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 223/446] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:45 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:28:46.312780 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1f4ca365-ca80-46e3-88a9-0320ee4c14d2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:46.313415 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1f4ca365-ca80-46e3-88a9-0320ee4c14d2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:46.320645 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f4ca365-ca80-46e3-88a9-0320ee4c14d2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:46.321121 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f4ca365-ca80-46e3-88a9-0320ee4c14d2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:46.321549 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f4ca365-ca80-46e3-88a9-0320ee4c14d2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:46.322244 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f4ca365-ca80-46e3-88a9-0320ee4c14d2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:46.322675 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f4ca365-ca80-46e3-88a9-0320ee4c14d2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:46.323094 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f4ca365-ca80-46e3-88a9-0320ee4c14d2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:46.459317 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1f4ca365-ca80-46e3-88a9-0320ee4c14d2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:46.467470 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1f4ca365-ca80-46e3-88a9-0320ee4c14d2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.158537 Aug 18 14:28:46.468295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 224/447] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:46 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:46.939390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-89db7ca3-d68d-43f7-87dd-95570e8b383a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:46.941740 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-89db7ca3-d68d-43f7-87dd-95570e8b383a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:46.948257 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89db7ca3-d68d-43f7-87dd-95570e8b383a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:46.948741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89db7ca3-d68d-43f7-87dd-95570e8b383a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:46.949179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89db7ca3-d68d-43f7-87dd-95570e8b383a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:46.949878 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89db7ca3-d68d-43f7-87dd-95570e8b383a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:46.950331 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89db7ca3-d68d-43f7-87dd-95570e8b383a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:46.950760 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89db7ca3-d68d-43f7-87dd-95570e8b383a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:46.980185 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-89db7ca3-d68d-43f7-87dd-95570e8b383a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044753 Aug 18 14:28:46.980740 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 224/448] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:28:46 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:28:47.079387 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-37ec6f98-ce09-43a3-99bc-f13ebb0fc791 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:47.079999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-37ec6f98-ce09-43a3-99bc-f13ebb0fc791 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:47.086402 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37ec6f98-ce09-43a3-99bc-f13ebb0fc791 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:47.086879 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37ec6f98-ce09-43a3-99bc-f13ebb0fc791 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:47.087315 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37ec6f98-ce09-43a3-99bc-f13ebb0fc791 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:47.088020 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37ec6f98-ce09-43a3-99bc-f13ebb0fc791 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:47.088473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37ec6f98-ce09-43a3-99bc-f13ebb0fc791 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:47.088894 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37ec6f98-ce09-43a3-99bc-f13ebb0fc791 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:47.220320 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-37ec6f98-ce09-43a3-99bc-f13ebb0fc791 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:47.229795 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-37ec6f98-ce09-43a3-99bc-f13ebb0fc791 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:47.231290 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-37ec6f98-ce09-43a3-99bc-f13ebb0fc791 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:47.232466 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-37ec6f98-ce09-43a3-99bc-f13ebb0fc791 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.156995 Aug 18 14:28:47.233016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 225/449] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:47 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:47.491337 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4bf32e4b-5a63-42ef-83e2-9879085c7431 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:47.492497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4bf32e4b-5a63-42ef-83e2-9879085c7431 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:47.498460 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bf32e4b-5a63-42ef-83e2-9879085c7431 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:47.498934 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bf32e4b-5a63-42ef-83e2-9879085c7431 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:47.499381 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bf32e4b-5a63-42ef-83e2-9879085c7431 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:47.500064 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bf32e4b-5a63-42ef-83e2-9879085c7431 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:47.500510 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bf32e4b-5a63-42ef-83e2-9879085c7431 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:47.500929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bf32e4b-5a63-42ef-83e2-9879085c7431 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:47.749940 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4bf32e4b-5a63-42ef-83e2-9879085c7431 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:47.760571 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4bf32e4b-5a63-42ef-83e2-9879085c7431 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.275193 Aug 18 14:28:47.761767 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 225/450] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:47 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:47.992479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c916a7e7-2b8c-4f38-929d-146bd0f18ae6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:47.994864 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c916a7e7-2b8c-4f38-929d-146bd0f18ae6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:48.001032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c916a7e7-2b8c-4f38-929d-146bd0f18ae6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:48.001833 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c916a7e7-2b8c-4f38-929d-146bd0f18ae6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:48.002487 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c916a7e7-2b8c-4f38-929d-146bd0f18ae6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:48.003913 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c916a7e7-2b8c-4f38-929d-146bd0f18ae6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:48.004603 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c916a7e7-2b8c-4f38-929d-146bd0f18ae6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:48.005521 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c916a7e7-2b8c-4f38-929d-146bd0f18ae6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:48.044919 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c916a7e7-2b8c-4f38-929d-146bd0f18ae6 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056364 Aug 18 14:28:48.045695 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 226/451] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:28:47 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:28:48.048904 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-587347172", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "networks": [{"uuid": "c714e51c-eb2a-4d87-9390-e0cd68593e4c"}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:28:48.112109 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d428abff-a62e-441c-91b1-5442e43edc19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:48.113625 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d428abff-a62e-441c-91b1-5442e43edc19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:48.117057 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] validate_networks() for [('c714e51c-eb2a-4d87-9390-e0cd68593e4c', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:28:48.120874 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d428abff-a62e-441c-91b1-5442e43edc19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:48.121548 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d428abff-a62e-441c-91b1-5442e43edc19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:48.122165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d428abff-a62e-441c-91b1-5442e43edc19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:48.122867 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d428abff-a62e-441c-91b1-5442e43edc19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:48.123507 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d428abff-a62e-441c-91b1-5442e43edc19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:48.124131 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d428abff-a62e-441c-91b1-5442e43edc19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:48.150393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d428abff-a62e-441c-91b1-5442e43edc19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:28:48.250813 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d428abff-a62e-441c-91b1-5442e43edc19 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 204 len: 0 microversion: 2.1 time: 0.140574 Aug 18 14:28:48.251551 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 227/452] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:28:48 2022] DELETE /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:28:48.258503 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6feb25d9-898a-4fe9-8ef0-4ecea65eeae5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:48.259203 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6feb25d9-898a-4fe9-8ef0-4ecea65eeae5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:48.265729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6feb25d9-898a-4fe9-8ef0-4ecea65eeae5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:48.266245 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6feb25d9-898a-4fe9-8ef0-4ecea65eeae5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:48.266683 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6feb25d9-898a-4fe9-8ef0-4ecea65eeae5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:48.267396 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6feb25d9-898a-4fe9-8ef0-4ecea65eeae5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:48.267853 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6feb25d9-898a-4fe9-8ef0-4ecea65eeae5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:48.268281 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6feb25d9-898a-4fe9-8ef0-4ecea65eeae5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:48.405830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6feb25d9-898a-4fe9-8ef0-4ecea65eeae5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:48.415321 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6feb25d9-898a-4fe9-8ef0-4ecea65eeae5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:48.416918 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6feb25d9-898a-4fe9-8ef0-4ecea65eeae5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:48.418078 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6feb25d9-898a-4fe9-8ef0-4ecea65eeae5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.163922 Aug 18 14:28:48.418634 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 228/453] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:48 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:48.422999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b4f3446d-a395-4714-a61a-1b549bee48f9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:48.423634 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b4f3446d-a395-4714-a61a-1b549bee48f9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:48.429970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4f3446d-a395-4714-a61a-1b549bee48f9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:48.430649 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4f3446d-a395-4714-a61a-1b549bee48f9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:48.431085 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4f3446d-a395-4714-a61a-1b549bee48f9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:48.431802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4f3446d-a395-4714-a61a-1b549bee48f9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:48.432420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4f3446d-a395-4714-a61a-1b549bee48f9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:48.432843 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4f3446d-a395-4714-a61a-1b549bee48f9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:48.532016 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:28:48.532451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:28:48.532930 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:28:48.533366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:28:48.533762 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:28:48.543529 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:48.544018 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:48.544456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:48.545194 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:48.545647 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:48.546074 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:48.563602 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Getting quotas for project 4d1de27922464f9291f0999378307c06. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:28:48.567951 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Getting quotas for user 677239d934c04e50b024a001c0152e57 and project 4d1de27922464f9291f0999378307c06. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:28:48.570300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b4f3446d-a395-4714-a61a-1b549bee48f9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:48.578378 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b4f3446d-a395-4714-a61a-1b549bee48f9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1681 microversion: 2.1 time: 0.158768 Aug 18 14:28:48.578934 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 229/454] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:48 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:48.579291 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:28:48.581755 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:28:48.629498 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8a820b8a-848f-438a-b283-0765c4317a7a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584583 Aug 18 14:28:48.630216 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 226/455] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:28:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 14:28:48.640911 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-696b834a-4c90-4aa6-a4ee-7b0ac7823fca tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:48.641541 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-696b834a-4c90-4aa6-a4ee-7b0ac7823fca tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:48.696024 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-696b834a-4c90-4aa6-a4ee-7b0ac7823fca tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:48.703409 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-696b834a-4c90-4aa6-a4ee-7b0ac7823fca tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1218 microversion: 2.1 time: 0.066395 Aug 18 14:28:48.704062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 230/456] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:48 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:48.782014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-61075e06-a097-42ab-a8d9-2c09204a707d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:48.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-61075e06-a097-42ab-a8d9-2c09204a707d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:48.789012 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61075e06-a097-42ab-a8d9-2c09204a707d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:48.789513 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61075e06-a097-42ab-a8d9-2c09204a707d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:48.789917 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61075e06-a097-42ab-a8d9-2c09204a707d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:48.790612 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61075e06-a097-42ab-a8d9-2c09204a707d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:48.791068 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61075e06-a097-42ab-a8d9-2c09204a707d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:48.791524 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61075e06-a097-42ab-a8d9-2c09204a707d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:48.928885 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-61075e06-a097-42ab-a8d9-2c09204a707d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:48.937345 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-61075e06-a097-42ab-a8d9-2c09204a707d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.159166 Aug 18 14:28:48.937911 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 227/457] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:48 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:49.441875 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dcdabfc2-1c5b-446d-9276-edf66e4e7b71 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:49.442509 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dcdabfc2-1c5b-446d-9276-edf66e4e7b71 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:49.450337 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcdabfc2-1c5b-446d-9276-edf66e4e7b71 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:49.450552 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcdabfc2-1c5b-446d-9276-edf66e4e7b71 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:49.450879 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcdabfc2-1c5b-446d-9276-edf66e4e7b71 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:49.451632 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcdabfc2-1c5b-446d-9276-edf66e4e7b71 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:49.452097 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcdabfc2-1c5b-446d-9276-edf66e4e7b71 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:49.452528 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcdabfc2-1c5b-446d-9276-edf66e4e7b71 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:49.598337 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dcdabfc2-1c5b-446d-9276-edf66e4e7b71 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:49.600153 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2e393c5c-60cf-4b6a-857e-011ab7dc965d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:49.600905 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2e393c5c-60cf-4b6a-857e-011ab7dc965d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:49.607832 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e393c5c-60cf-4b6a-857e-011ab7dc965d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:49.608541 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e393c5c-60cf-4b6a-857e-011ab7dc965d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:49.608975 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e393c5c-60cf-4b6a-857e-011ab7dc965d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:49.609742 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dcdabfc2-1c5b-446d-9276-edf66e4e7b71 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:49.610040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e393c5c-60cf-4b6a-857e-011ab7dc965d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:49.610496 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e393c5c-60cf-4b6a-857e-011ab7dc965d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:49.611082 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e393c5c-60cf-4b6a-857e-011ab7dc965d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:49.611689 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dcdabfc2-1c5b-446d-9276-edf66e4e7b71 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:49.614102 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dcdabfc2-1c5b-446d-9276-edf66e4e7b71 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.176102 Aug 18 14:28:49.614983 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 231/458] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:49 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:49.617361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:49.724734 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3fe3b5d5-7238-4148-91ca-3c86c4ae11bd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:49.727026 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3fe3b5d5-7238-4148-91ca-3c86c4ae11bd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:49.733809 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fe3b5d5-7238-4148-91ca-3c86c4ae11bd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:49.734306 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fe3b5d5-7238-4148-91ca-3c86c4ae11bd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:49.734750 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fe3b5d5-7238-4148-91ca-3c86c4ae11bd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:49.735682 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fe3b5d5-7238-4148-91ca-3c86c4ae11bd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:49.736206 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fe3b5d5-7238-4148-91ca-3c86c4ae11bd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:49.737720 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fe3b5d5-7238-4148-91ca-3c86c4ae11bd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:49.752294 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2e393c5c-60cf-4b6a-857e-011ab7dc965d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:49.762802 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2e393c5c-60cf-4b6a-857e-011ab7dc965d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1681 microversion: 2.1 time: 0.166540 Aug 18 14:28:49.763397 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 228/459] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:49 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:49.811915 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3fe3b5d5-7238-4148-91ca-3c86c4ae11bd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:49.819523 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3fe3b5d5-7238-4148-91ca-3c86c4ae11bd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1214 microversion: 2.1 time: 0.098862 Aug 18 14:28:49.820084 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 232/460] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:49 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:28:49.959974 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-815711ab-ecd3-4d3d-af04-e450258c7e05 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:49.960667 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-815711ab-ecd3-4d3d-af04-e450258c7e05 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:49.967142 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-815711ab-ecd3-4d3d-af04-e450258c7e05 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:49.968072 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-815711ab-ecd3-4d3d-af04-e450258c7e05 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:49.968513 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-815711ab-ecd3-4d3d-af04-e450258c7e05 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:49.969263 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-815711ab-ecd3-4d3d-af04-e450258c7e05 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:49.969766 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-815711ab-ecd3-4d3d-af04-e450258c7e05 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:49.970324 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-815711ab-ecd3-4d3d-af04-e450258c7e05 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:50.302839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-815711ab-ecd3-4d3d-af04-e450258c7e05 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:50.319588 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-815711ab-ecd3-4d3d-af04-e450258c7e05 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.363987 Aug 18 14:28:50.320678 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 229/461] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:49 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:50.639344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a9738f11-d905-46b7-8e5f-1d102827c85e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:50.640593 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a9738f11-d905-46b7-8e5f-1d102827c85e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:50.648492 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9738f11-d905-46b7-8e5f-1d102827c85e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:50.649215 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9738f11-d905-46b7-8e5f-1d102827c85e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:50.649833 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9738f11-d905-46b7-8e5f-1d102827c85e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:50.650698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9738f11-d905-46b7-8e5f-1d102827c85e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:50.651147 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9738f11-d905-46b7-8e5f-1d102827c85e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:50.651777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9738f11-d905-46b7-8e5f-1d102827c85e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:50.788463 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-46a776ba-4de9-4d91-af74-791ca50201af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:50.789096 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-46a776ba-4de9-4d91-af74-791ca50201af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:50.794585 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a9738f11-d905-46b7-8e5f-1d102827c85e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:50.801993 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46a776ba-4de9-4d91-af74-791ca50201af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:50.802619 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46a776ba-4de9-4d91-af74-791ca50201af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:50.803122 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46a776ba-4de9-4d91-af74-791ca50201af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:50.804292 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a9738f11-d905-46b7-8e5f-1d102827c85e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:50.805790 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a9738f11-d905-46b7-8e5f-1d102827c85e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:50.807107 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a9738f11-d905-46b7-8e5f-1d102827c85e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.171946 Aug 18 14:28:50.811634 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46a776ba-4de9-4d91-af74-791ca50201af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:50.812627 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46a776ba-4de9-4d91-af74-791ca50201af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:50.813459 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46a776ba-4de9-4d91-af74-791ca50201af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:50.820497 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 233/462] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:50 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:50.840855 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8a19d594-7b43-48e5-9919-2490fe85986f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:50.841482 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8a19d594-7b43-48e5-9919-2490fe85986f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:50.851539 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a19d594-7b43-48e5-9919-2490fe85986f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:50.852017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a19d594-7b43-48e5-9919-2490fe85986f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:50.852482 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a19d594-7b43-48e5-9919-2490fe85986f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:50.853532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a19d594-7b43-48e5-9919-2490fe85986f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:50.853946 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a19d594-7b43-48e5-9919-2490fe85986f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:50.854404 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a19d594-7b43-48e5-9919-2490fe85986f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:50.936394 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8a19d594-7b43-48e5-9919-2490fe85986f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:50.945557 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8a19d594-7b43-48e5-9919-2490fe85986f tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1278 microversion: 2.1 time: 0.108784 Aug 18 14:28:50.946463 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 234/463] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:50 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1278 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:28:51.063783 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-46a776ba-4de9-4d91-af74-791ca50201af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:51.072552 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-46a776ba-4de9-4d91-af74-791ca50201af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1681 microversion: 2.1 time: 0.290354 Aug 18 14:28:51.073117 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 230/464] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:50 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1681 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:51.345532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1e2ad239-5bc5-4dfc-b1c9-0d6095adcf56 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:51.347303 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1e2ad239-5bc5-4dfc-b1c9-0d6095adcf56 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:51.353476 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e2ad239-5bc5-4dfc-b1c9-0d6095adcf56 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:51.354205 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e2ad239-5bc5-4dfc-b1c9-0d6095adcf56 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:51.354982 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e2ad239-5bc5-4dfc-b1c9-0d6095adcf56 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:51.355882 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e2ad239-5bc5-4dfc-b1c9-0d6095adcf56 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:51.356710 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e2ad239-5bc5-4dfc-b1c9-0d6095adcf56 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:51.357897 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e2ad239-5bc5-4dfc-b1c9-0d6095adcf56 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:51.551626 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-5bb53dea-f742-4dbe-b7c5-6e96f9d649db req-be6df43b-2d75-4ce3-9172-64d9f50745b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed05a0ad-3aad-4113-b8b3-8daa97e04f2f", "name": "network-vif-deleted", "tag": "4de21cfe-6345-4dbd-890d-aa61bf0849bf"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:28:51.557494 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1e2ad239-5bc5-4dfc-b1c9-0d6095adcf56 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:51.561351 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5bb53dea-f742-4dbe-b7c5-6e96f9d649db req-be6df43b-2d75-4ce3-9172-64d9f50745b8 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:51.561840 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5bb53dea-f742-4dbe-b7c5-6e96f9d649db req-be6df43b-2d75-4ce3-9172-64d9f50745b8 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:51.562273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5bb53dea-f742-4dbe-b7c5-6e96f9d649db req-be6df43b-2d75-4ce3-9172-64d9f50745b8 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:51.568024 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1e2ad239-5bc5-4dfc-b1c9-0d6095adcf56 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.226614 Aug 18 14:28:51.569265 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 235/465] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:51 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:51.574209 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-5bb53dea-f742-4dbe-b7c5-6e96f9d649db req-be6df43b-2d75-4ce3-9172-64d9f50745b8 service nova] Creating event network-vif-deleted:4de21cfe-6345-4dbd-890d-aa61bf0849bf for instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f on hv-cinder-85220 Aug 18 14:28:51.584609 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-5bb53dea-f742-4dbe-b7c5-6e96f9d649db req-be6df43b-2d75-4ce3-9172-64d9f50745b8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038318 Aug 18 14:28:51.585218 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 231/466] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:28:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:28:51.833545 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-62f7b4c4-506d-43fc-95e3-24ae23473754 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:51.834335 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-62f7b4c4-506d-43fc-95e3-24ae23473754 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:51.843107 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62f7b4c4-506d-43fc-95e3-24ae23473754 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:51.843619 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62f7b4c4-506d-43fc-95e3-24ae23473754 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:51.844053 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62f7b4c4-506d-43fc-95e3-24ae23473754 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:51.850251 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62f7b4c4-506d-43fc-95e3-24ae23473754 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:51.860107 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62f7b4c4-506d-43fc-95e3-24ae23473754 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:51.860860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62f7b4c4-506d-43fc-95e3-24ae23473754 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:51.970413 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e55e8fa9-94e7-4af5-9dad-cf3d1e26850e tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:51.973070 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e55e8fa9-94e7-4af5-9dad-cf3d1e26850e tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:51.990222 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e55e8fa9-94e7-4af5-9dad-cf3d1e26850e tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:51.990747 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e55e8fa9-94e7-4af5-9dad-cf3d1e26850e tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:51.994641 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e55e8fa9-94e7-4af5-9dad-cf3d1e26850e tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:51.995665 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e55e8fa9-94e7-4af5-9dad-cf3d1e26850e tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:51.996304 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e55e8fa9-94e7-4af5-9dad-cf3d1e26850e tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:51.999164 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e55e8fa9-94e7-4af5-9dad-cf3d1e26850e tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:52.029574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-62f7b4c4-506d-43fc-95e3-24ae23473754 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:52.050975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-62f7b4c4-506d-43fc-95e3-24ae23473754 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:52.053170 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-62f7b4c4-506d-43fc-95e3-24ae23473754 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:52.055104 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-62f7b4c4-506d-43fc-95e3-24ae23473754 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.226862 Aug 18 14:28:52.060403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 236/467] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:51 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:52.085192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e55e8fa9-94e7-4af5-9dad-cf3d1e26850e tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:52.094443 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-18816625-698e-49ad-9ee2-6206b92fa90e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:52.095064 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-18816625-698e-49ad-9ee2-6206b92fa90e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:52.095279 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e55e8fa9-94e7-4af5-9dad-cf3d1e26850e tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1278 microversion: 2.1 time: 0.130761 Aug 18 14:28:52.096705 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 232/468] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:51 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1278 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:28:52.114934 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18816625-698e-49ad-9ee2-6206b92fa90e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:52.115532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18816625-698e-49ad-9ee2-6206b92fa90e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:52.116046 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18816625-698e-49ad-9ee2-6206b92fa90e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:52.116836 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18816625-698e-49ad-9ee2-6206b92fa90e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:52.117304 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18816625-698e-49ad-9ee2-6206b92fa90e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:52.117859 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18816625-698e-49ad-9ee2-6206b92fa90e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:52.198321 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-18816625-698e-49ad-9ee2-6206b92fa90e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:52.207267 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-18816625-698e-49ad-9ee2-6206b92fa90e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1613 microversion: 2.1 time: 0.116775 Aug 18 14:28:52.222111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 237/469] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:52 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1613 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:28:52.589847 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4585eba8-9bb3-4e98-8878-279621d6ccb5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:52.591129 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4585eba8-9bb3-4e98-8878-279621d6ccb5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:52.599127 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4585eba8-9bb3-4e98-8878-279621d6ccb5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:52.600071 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4585eba8-9bb3-4e98-8878-279621d6ccb5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:52.601157 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4585eba8-9bb3-4e98-8878-279621d6ccb5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:52.602115 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4585eba8-9bb3-4e98-8878-279621d6ccb5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:52.602667 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4585eba8-9bb3-4e98-8878-279621d6ccb5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:52.603585 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4585eba8-9bb3-4e98-8878-279621d6ccb5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:52.747038 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4585eba8-9bb3-4e98-8878-279621d6ccb5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:52.761089 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4585eba8-9bb3-4e98-8878-279621d6ccb5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.175173 Aug 18 14:28:52.762116 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 233/470] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:52 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:53.084974 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5c9744f5-466f-4ec1-af44-d27295ab9c17 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:53.085600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5c9744f5-466f-4ec1-af44-d27295ab9c17 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:53.092100 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c9744f5-466f-4ec1-af44-d27295ab9c17 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:53.092584 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c9744f5-466f-4ec1-af44-d27295ab9c17 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:53.093287 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c9744f5-466f-4ec1-af44-d27295ab9c17 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:53.094064 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c9744f5-466f-4ec1-af44-d27295ab9c17 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:53.094518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c9744f5-466f-4ec1-af44-d27295ab9c17 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:53.094944 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c9744f5-466f-4ec1-af44-d27295ab9c17 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:53.097724 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:53.116165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1aaeff21-9595-4d52-bf19-a5544925f742 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:53.116784 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1aaeff21-9595-4d52-bf19-a5544925f742 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:53.123595 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aaeff21-9595-4d52-bf19-a5544925f742 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:53.124343 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aaeff21-9595-4d52-bf19-a5544925f742 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:53.124788 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aaeff21-9595-4d52-bf19-a5544925f742 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:53.125497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aaeff21-9595-4d52-bf19-a5544925f742 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:53.125952 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aaeff21-9595-4d52-bf19-a5544925f742 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:53.126377 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aaeff21-9595-4d52-bf19-a5544925f742 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:53.197853 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1aaeff21-9595-4d52-bf19-a5544925f742 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:53.206612 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1aaeff21-9595-4d52-bf19-a5544925f742 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1278 microversion: 2.1 time: 0.094451 Aug 18 14:28:53.207768 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 234/471] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:53 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:28:53.229842 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2ca01665-8804-4cc3-a4dd-ebd68b8b8713 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:53.230466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2ca01665-8804-4cc3-a4dd-ebd68b8b8713 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:53.237579 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ca01665-8804-4cc3-a4dd-ebd68b8b8713 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:53.238150 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ca01665-8804-4cc3-a4dd-ebd68b8b8713 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:53.238588 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ca01665-8804-4cc3-a4dd-ebd68b8b8713 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:53.239300 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ca01665-8804-4cc3-a4dd-ebd68b8b8713 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:53.239779 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ca01665-8804-4cc3-a4dd-ebd68b8b8713 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:53.240211 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ca01665-8804-4cc3-a4dd-ebd68b8b8713 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:53.283121 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5c9744f5-466f-4ec1-af44-d27295ab9c17 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:53.292175 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5c9744f5-466f-4ec1-af44-d27295ab9c17 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:53.293804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5c9744f5-466f-4ec1-af44-d27295ab9c17 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:53.294996 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5c9744f5-466f-4ec1-af44-d27295ab9c17 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.214584 Aug 18 14:28:53.295583 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 238/472] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:53 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:53.314858 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2ca01665-8804-4cc3-a4dd-ebd68b8b8713 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:53.324001 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2ca01665-8804-4cc3-a4dd-ebd68b8b8713 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1613 microversion: 2.1 time: 0.098738 Aug 18 14:28:53.324889 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 235/473] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:53 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1613 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:28:53.782948 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-50c9ad26-d04b-4422-b88c-594fc4833b69 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:53.783605 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-50c9ad26-d04b-4422-b88c-594fc4833b69 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:53.790295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50c9ad26-d04b-4422-b88c-594fc4833b69 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:53.790790 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50c9ad26-d04b-4422-b88c-594fc4833b69 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:53.791234 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50c9ad26-d04b-4422-b88c-594fc4833b69 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:53.792056 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50c9ad26-d04b-4422-b88c-594fc4833b69 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:53.792504 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50c9ad26-d04b-4422-b88c-594fc4833b69 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:53.792930 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50c9ad26-d04b-4422-b88c-594fc4833b69 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:53.934133 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-50c9ad26-d04b-4422-b88c-594fc4833b69 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:53.943572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-50c9ad26-d04b-4422-b88c-594fc4833b69 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.164356 Aug 18 14:28:53.958437 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 239/474] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:53 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:54.230986 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-38e78e35-295a-48c0-bf62-4b37e633d681 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:54.232250 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-38e78e35-295a-48c0-bf62-4b37e633d681 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:54.236542 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:54.243859 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38e78e35-295a-48c0-bf62-4b37e633d681 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:54.244940 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38e78e35-295a-48c0-bf62-4b37e633d681 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:54.245396 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38e78e35-295a-48c0-bf62-4b37e633d681 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:54.246133 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38e78e35-295a-48c0-bf62-4b37e633d681 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:54.246579 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38e78e35-295a-48c0-bf62-4b37e633d681 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:54.247199 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38e78e35-295a-48c0-bf62-4b37e633d681 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:54.319879 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7f39fad3-dcf5-4475-a439-5e471d7dac27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:54.320564 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7f39fad3-dcf5-4475-a439-5e471d7dac27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:54.321199 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-38e78e35-295a-48c0-bf62-4b37e633d681 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:54.327321 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f39fad3-dcf5-4475-a439-5e471d7dac27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:54.327854 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f39fad3-dcf5-4475-a439-5e471d7dac27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:54.328293 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f39fad3-dcf5-4475-a439-5e471d7dac27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:54.328879 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-38e78e35-295a-48c0-bf62-4b37e633d681 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1278 microversion: 2.1 time: 0.103992 Aug 18 14:28:54.329174 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f39fad3-dcf5-4475-a439-5e471d7dac27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:54.329445 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 236/475] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:54 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1278 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:54.329744 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f39fad3-dcf5-4475-a439-5e471d7dac27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:54.330243 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f39fad3-dcf5-4475-a439-5e471d7dac27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:54.347435 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-24299886-0588-471b-bc93-02dad06f9e13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:54.348062 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-24299886-0588-471b-bc93-02dad06f9e13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:54.356363 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24299886-0588-471b-bc93-02dad06f9e13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:54.356866 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24299886-0588-471b-bc93-02dad06f9e13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:54.357308 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24299886-0588-471b-bc93-02dad06f9e13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:54.358021 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24299886-0588-471b-bc93-02dad06f9e13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:54.358476 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24299886-0588-471b-bc93-02dad06f9e13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:54.359081 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24299886-0588-471b-bc93-02dad06f9e13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:54.430070 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-24299886-0588-471b-bc93-02dad06f9e13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:54.442662 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-24299886-0588-471b-bc93-02dad06f9e13 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1613 microversion: 2.1 time: 0.098954 Aug 18 14:28:54.447417 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 237/476] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:54 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:54.494458 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7f39fad3-dcf5-4475-a439-5e471d7dac27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:54.504501 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7f39fad3-dcf5-4475-a439-5e471d7dac27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:54.506011 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7f39fad3-dcf5-4475-a439-5e471d7dac27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:54.507199 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7f39fad3-dcf5-4475-a439-5e471d7dac27 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.191902 Aug 18 14:28:54.508500 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 240/477] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:54 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:28:54.965500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9c509ac3-59e5-41cd-80a8-51ba8d37a9b2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:54.968959 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9c509ac3-59e5-41cd-80a8-51ba8d37a9b2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:54.974929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c509ac3-59e5-41cd-80a8-51ba8d37a9b2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:54.974929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c509ac3-59e5-41cd-80a8-51ba8d37a9b2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:54.974929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c509ac3-59e5-41cd-80a8-51ba8d37a9b2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:54.975620 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c509ac3-59e5-41cd-80a8-51ba8d37a9b2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:54.976080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c509ac3-59e5-41cd-80a8-51ba8d37a9b2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:54.976511 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c509ac3-59e5-41cd-80a8-51ba8d37a9b2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:55.114938 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9c509ac3-59e5-41cd-80a8-51ba8d37a9b2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:55.123700 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9c509ac3-59e5-41cd-80a8-51ba8d37a9b2 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.162207 Aug 18 14:28:55.131801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 238/478] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:54 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:28:55.350427 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-66184103-01fc-4166-af22-428f82a9199c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:55.351038 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-66184103-01fc-4166-af22-428f82a9199c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:55.354015 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:55.358136 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66184103-01fc-4166-af22-428f82a9199c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:55.358622 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66184103-01fc-4166-af22-428f82a9199c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:55.359058 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66184103-01fc-4166-af22-428f82a9199c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:55.359786 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66184103-01fc-4166-af22-428f82a9199c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:55.360237 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66184103-01fc-4166-af22-428f82a9199c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:55.360661 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66184103-01fc-4166-af22-428f82a9199c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:55.428459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-66184103-01fc-4166-af22-428f82a9199c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:55.437221 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-66184103-01fc-4166-af22-428f82a9199c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1278 microversion: 2.1 time: 0.091178 Aug 18 14:28:55.448678 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 241/479] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:55 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1278 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:55.466088 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-acf747f8-e358-426b-ba80-a330092d6171 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:55.467011 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-acf747f8-e358-426b-ba80-a330092d6171 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:55.484519 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acf747f8-e358-426b-ba80-a330092d6171 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:55.484519 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acf747f8-e358-426b-ba80-a330092d6171 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:55.484519 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acf747f8-e358-426b-ba80-a330092d6171 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:55.484519 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acf747f8-e358-426b-ba80-a330092d6171 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:55.485016 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acf747f8-e358-426b-ba80-a330092d6171 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:55.485016 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acf747f8-e358-426b-ba80-a330092d6171 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:55.532239 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-93253600-f8d0-4867-b541-9cf2e16c9439 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:55.532852 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-93253600-f8d0-4867-b541-9cf2e16c9439 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:55.539642 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93253600-f8d0-4867-b541-9cf2e16c9439 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:55.540580 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93253600-f8d0-4867-b541-9cf2e16c9439 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:55.540580 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93253600-f8d0-4867-b541-9cf2e16c9439 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:55.541268 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93253600-f8d0-4867-b541-9cf2e16c9439 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:55.541728 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93253600-f8d0-4867-b541-9cf2e16c9439 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:55.542158 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93253600-f8d0-4867-b541-9cf2e16c9439 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:55.542509 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-acf747f8-e358-426b-ba80-a330092d6171 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:55.550417 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-acf747f8-e358-426b-ba80-a330092d6171 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1613 microversion: 2.1 time: 0.088166 Aug 18 14:28:55.550991 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 239/480] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:55 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:55.686669 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-93253600-f8d0-4867-b541-9cf2e16c9439 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:55.695936 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-93253600-f8d0-4867-b541-9cf2e16c9439 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:55.697431 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-93253600-f8d0-4867-b541-9cf2e16c9439 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:55.698593 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-93253600-f8d0-4867-b541-9cf2e16c9439 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.170339 Aug 18 14:28:55.699155 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 242/481] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:55 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:28:56.146069 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8306628a-6119-44ab-a824-84065ae1793b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:56.146678 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8306628a-6119-44ab-a824-84065ae1793b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:56.152944 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8306628a-6119-44ab-a824-84065ae1793b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:56.153429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8306628a-6119-44ab-a824-84065ae1793b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:56.153860 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8306628a-6119-44ab-a824-84065ae1793b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:56.154551 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8306628a-6119-44ab-a824-84065ae1793b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:56.154999 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8306628a-6119-44ab-a824-84065ae1793b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:56.155439 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8306628a-6119-44ab-a824-84065ae1793b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:56.317770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8306628a-6119-44ab-a824-84065ae1793b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:56.326074 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8306628a-6119-44ab-a824-84065ae1793b tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.184787 Aug 18 14:28:56.326642 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 240/482] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:56 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:56.462515 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e3996afd-484b-4759-831f-599df4cce55c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:56.464182 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e3996afd-484b-4759-831f-599df4cce55c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:56.473459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3996afd-484b-4759-831f-599df4cce55c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:56.474105 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3996afd-484b-4759-831f-599df4cce55c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:56.474553 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3996afd-484b-4759-831f-599df4cce55c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:56.475261 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3996afd-484b-4759-831f-599df4cce55c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:56.475782 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3996afd-484b-4759-831f-599df4cce55c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:56.476214 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3996afd-484b-4759-831f-599df4cce55c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:56.540098 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e3996afd-484b-4759-831f-599df4cce55c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:56.547889 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e3996afd-484b-4759-831f-599df4cce55c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1278 microversion: 2.1 time: 0.091090 Aug 18 14:28:56.548454 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 243/483] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:56 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:56.571452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dc111e20-f00b-4f83-b0cb-1be89bd073ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:56.572068 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dc111e20-f00b-4f83-b0cb-1be89bd073ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:56.578446 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc111e20-f00b-4f83-b0cb-1be89bd073ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:56.578927 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc111e20-f00b-4f83-b0cb-1be89bd073ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:56.580013 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc111e20-f00b-4f83-b0cb-1be89bd073ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:56.580712 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc111e20-f00b-4f83-b0cb-1be89bd073ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:56.581522 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc111e20-f00b-4f83-b0cb-1be89bd073ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:56.581990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc111e20-f00b-4f83-b0cb-1be89bd073ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:56.653601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc111e20-f00b-4f83-b0cb-1be89bd073ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:56.662585 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dc111e20-f00b-4f83-b0cb-1be89bd073ff tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1613 microversion: 2.1 time: 0.094853 Aug 18 14:28:56.663349 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 241/484] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:56 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:56.723008 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dbd90f54-063f-41df-8efb-ae6b1c95644c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:56.723574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dbd90f54-063f-41df-8efb-ae6b1c95644c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:56.729530 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbd90f54-063f-41df-8efb-ae6b1c95644c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:56.730016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbd90f54-063f-41df-8efb-ae6b1c95644c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:56.730482 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbd90f54-063f-41df-8efb-ae6b1c95644c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:56.731175 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbd90f54-063f-41df-8efb-ae6b1c95644c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:56.731662 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbd90f54-063f-41df-8efb-ae6b1c95644c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:56.732087 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbd90f54-063f-41df-8efb-ae6b1c95644c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:56.877422 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dbd90f54-063f-41df-8efb-ae6b1c95644c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:56.886447 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dbd90f54-063f-41df-8efb-ae6b1c95644c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:56.887994 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dbd90f54-063f-41df-8efb-ae6b1c95644c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:56.889165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dbd90f54-063f-41df-8efb-ae6b1c95644c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.171050 Aug 18 14:28:56.889731 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 244/485] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:56 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:57.346273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cc2f0a35-0d5a-49c8-951e-d47e593c29b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:57.346876 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cc2f0a35-0d5a-49c8-951e-d47e593c29b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:57.352997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc2f0a35-0d5a-49c8-951e-d47e593c29b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:57.353484 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc2f0a35-0d5a-49c8-951e-d47e593c29b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:57.353921 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc2f0a35-0d5a-49c8-951e-d47e593c29b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:57.354633 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc2f0a35-0d5a-49c8-951e-d47e593c29b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:57.355083 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc2f0a35-0d5a-49c8-951e-d47e593c29b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:57.355535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc2f0a35-0d5a-49c8-951e-d47e593c29b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:57.489665 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cc2f0a35-0d5a-49c8-951e-d47e593c29b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:57.498924 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cc2f0a35-0d5a-49c8-951e-d47e593c29b0 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.156673 Aug 18 14:28:57.510292 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 242/486] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:57 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:57.569698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0229a9cc-1242-431e-b4d4-6a0789941066 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:57.570355 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0229a9cc-1242-431e-b4d4-6a0789941066 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:57.576790 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0229a9cc-1242-431e-b4d4-6a0789941066 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:57.577266 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0229a9cc-1242-431e-b4d4-6a0789941066 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:57.577695 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0229a9cc-1242-431e-b4d4-6a0789941066 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:57.578381 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0229a9cc-1242-431e-b4d4-6a0789941066 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:57.578831 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0229a9cc-1242-431e-b4d4-6a0789941066 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:57.579251 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0229a9cc-1242-431e-b4d4-6a0789941066 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:57.648027 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0229a9cc-1242-431e-b4d4-6a0789941066 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:57.655736 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0229a9cc-1242-431e-b4d4-6a0789941066 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1278 microversion: 2.1 time: 0.089761 Aug 18 14:28:57.656495 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 245/487] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:57 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:57.693098 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f84d22b9-f9d0-4922-a510-8af0393afb7c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:57.694196 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f84d22b9-f9d0-4922-a510-8af0393afb7c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:57.701734 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f84d22b9-f9d0-4922-a510-8af0393afb7c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:57.702230 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f84d22b9-f9d0-4922-a510-8af0393afb7c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:57.702667 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f84d22b9-f9d0-4922-a510-8af0393afb7c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:57.703553 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f84d22b9-f9d0-4922-a510-8af0393afb7c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:57.707866 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f84d22b9-f9d0-4922-a510-8af0393afb7c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:57.708427 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f84d22b9-f9d0-4922-a510-8af0393afb7c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:57.792911 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f84d22b9-f9d0-4922-a510-8af0393afb7c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:57.810451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f84d22b9-f9d0-4922-a510-8af0393afb7c tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1613 microversion: 2.1 time: 0.124397 Aug 18 14:28:57.811378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 243/488] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:57 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1613 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:57.911864 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e9a1c2b4-f192-4ea0-829b-d6cadc719d10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:57.912481 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e9a1c2b4-f192-4ea0-829b-d6cadc719d10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:57.919068 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9a1c2b4-f192-4ea0-829b-d6cadc719d10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:57.919599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9a1c2b4-f192-4ea0-829b-d6cadc719d10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:57.920049 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9a1c2b4-f192-4ea0-829b-d6cadc719d10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:57.920753 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9a1c2b4-f192-4ea0-829b-d6cadc719d10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:57.921186 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9a1c2b4-f192-4ea0-829b-d6cadc719d10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:57.921600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9a1c2b4-f192-4ea0-829b-d6cadc719d10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:58.069097 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e9a1c2b4-f192-4ea0-829b-d6cadc719d10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:58.078541 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e9a1c2b4-f192-4ea0-829b-d6cadc719d10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:58.080224 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e9a1c2b4-f192-4ea0-829b-d6cadc719d10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:58.082688 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e9a1c2b4-f192-4ea0-829b-d6cadc719d10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.174386 Aug 18 14:28:58.083491 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 246/489] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:57 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:58.521792 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-26f91601-5e5e-474c-b3fa-223a7fba5387 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:58.522409 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-26f91601-5e5e-474c-b3fa-223a7fba5387 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:58.529287 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f91601-5e5e-474c-b3fa-223a7fba5387 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:58.529838 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f91601-5e5e-474c-b3fa-223a7fba5387 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:58.530273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f91601-5e5e-474c-b3fa-223a7fba5387 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:58.531001 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f91601-5e5e-474c-b3fa-223a7fba5387 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:58.531647 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f91601-5e5e-474c-b3fa-223a7fba5387 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:58.532099 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f91601-5e5e-474c-b3fa-223a7fba5387 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:58.553767 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:58.574566 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:58.667954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26f91601-5e5e-474c-b3fa-223a7fba5387 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:58.677770 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ceeecb22-ab8b-48a8-ba00-9a06ca5af6f4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:58.679280 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-26f91601-5e5e-474c-b3fa-223a7fba5387 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.162032 Aug 18 14:28:58.679605 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ceeecb22-ab8b-48a8-ba00-9a06ca5af6f4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:58.699529 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 244/490] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:58 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:58.702544 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:58.709092 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ceeecb22-ab8b-48a8-ba00-9a06ca5af6f4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:58.709592 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ceeecb22-ab8b-48a8-ba00-9a06ca5af6f4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:58.710032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ceeecb22-ab8b-48a8-ba00-9a06ca5af6f4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:58.710802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ceeecb22-ab8b-48a8-ba00-9a06ca5af6f4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:58.711261 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ceeecb22-ab8b-48a8-ba00-9a06ca5af6f4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:58.711725 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ceeecb22-ab8b-48a8-ba00-9a06ca5af6f4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:58.774767 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ceeecb22-ab8b-48a8-ba00-9a06ca5af6f4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:58.782364 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ceeecb22-ab8b-48a8-ba00-9a06ca5af6f4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1278 microversion: 2.1 time: 0.109866 Aug 18 14:28:58.782921 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 247/491] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:58 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1278 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:58.832954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6c9028fc-56dc-4e79-a71c-46978b34fcb1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:58.833599 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6c9028fc-56dc-4e79-a71c-46978b34fcb1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:58.839994 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c9028fc-56dc-4e79-a71c-46978b34fcb1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:58.840476 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c9028fc-56dc-4e79-a71c-46978b34fcb1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:58.840916 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c9028fc-56dc-4e79-a71c-46978b34fcb1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:58.841605 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c9028fc-56dc-4e79-a71c-46978b34fcb1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:58.842059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c9028fc-56dc-4e79-a71c-46978b34fcb1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:58.842485 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c9028fc-56dc-4e79-a71c-46978b34fcb1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:58.857572 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:28:58.904830 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6c9028fc-56dc-4e79-a71c-46978b34fcb1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:58.912475 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6c9028fc-56dc-4e79-a71c-46978b34fcb1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1613 microversion: 2.1 time: 0.083982 Aug 18 14:28:58.913039 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 245/492] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:58 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:28:59.106039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-97d89f19-0cca-4a91-af3c-e50615596fad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:59.106660 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-97d89f19-0cca-4a91-af3c-e50615596fad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:59.113256 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97d89f19-0cca-4a91-af3c-e50615596fad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:59.113631 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97d89f19-0cca-4a91-af3c-e50615596fad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:59.114070 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97d89f19-0cca-4a91-af3c-e50615596fad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:59.114753 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97d89f19-0cca-4a91-af3c-e50615596fad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:59.115238 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97d89f19-0cca-4a91-af3c-e50615596fad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:59.115654 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97d89f19-0cca-4a91-af3c-e50615596fad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:59.249525 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97d89f19-0cca-4a91-af3c-e50615596fad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:59.259052 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97d89f19-0cca-4a91-af3c-e50615596fad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:59.260582 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97d89f19-0cca-4a91-af3c-e50615596fad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:59.261729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-97d89f19-0cca-4a91-af3c-e50615596fad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.159600 Aug 18 14:28:59.262288 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 248/493] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:28:59 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:28:59.713058 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4a17aa09-e234-4fa3-9507-8492f3e518b3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:59.713821 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4a17aa09-e234-4fa3-9507-8492f3e518b3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:59.722765 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a17aa09-e234-4fa3-9507-8492f3e518b3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:59.723544 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a17aa09-e234-4fa3-9507-8492f3e518b3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:59.724119 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a17aa09-e234-4fa3-9507-8492f3e518b3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:59.724856 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a17aa09-e234-4fa3-9507-8492f3e518b3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:59.725379 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a17aa09-e234-4fa3-9507-8492f3e518b3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:59.725893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a17aa09-e234-4fa3-9507-8492f3e518b3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:59.804340 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cfe2be73-2775-42d8-99bd-74b7472dd941 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:59.806362 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cfe2be73-2775-42d8-99bd-74b7472dd941 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:59.811661 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfe2be73-2775-42d8-99bd-74b7472dd941 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:59.812146 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfe2be73-2775-42d8-99bd-74b7472dd941 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:59.813047 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfe2be73-2775-42d8-99bd-74b7472dd941 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:59.813824 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfe2be73-2775-42d8-99bd-74b7472dd941 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:59.814479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfe2be73-2775-42d8-99bd-74b7472dd941 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:59.815886 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfe2be73-2775-42d8-99bd-74b7472dd941 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:59.888584 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cfe2be73-2775-42d8-99bd-74b7472dd941 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:59.897214 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cfe2be73-2775-42d8-99bd-74b7472dd941 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1278 microversion: 2.1 time: 0.097722 Aug 18 14:28:59.897829 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 249/494] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:59 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:28:59.934096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2513d22f-6ae8-4e88-af8a-39323bfdb419 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:28:59.934959 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2513d22f-6ae8-4e88-af8a-39323bfdb419 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:28:59.942112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2513d22f-6ae8-4e88-af8a-39323bfdb419 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:59.942597 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2513d22f-6ae8-4e88-af8a-39323bfdb419 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:59.943031 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2513d22f-6ae8-4e88-af8a-39323bfdb419 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:59.943771 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2513d22f-6ae8-4e88-af8a-39323bfdb419 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:28:59.944239 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2513d22f-6ae8-4e88-af8a-39323bfdb419 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:28:59.944644 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2513d22f-6ae8-4e88-af8a-39323bfdb419 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:28:59.954581 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4a17aa09-e234-4fa3-9507-8492f3e518b3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:28:59.962922 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4a17aa09-e234-4fa3-9507-8492f3e518b3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.254475 Aug 18 14:28:59.963595 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 246/495] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:59 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:00.006739 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2513d22f-6ae8-4e88-af8a-39323bfdb419 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:00.014900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2513d22f-6ae8-4e88-af8a-39323bfdb419 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 200 len: 1326 microversion: 2.1 time: 0.084671 Aug 18 14:29:00.015476 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 250/496] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:28:59 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 1326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:29:00.289146 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dfabdb7d-bb2f-4f5b-b2a2-ce9101ef4836 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:00.289768 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dfabdb7d-bb2f-4f5b-b2a2-ce9101ef4836 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:00.297178 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfabdb7d-bb2f-4f5b-b2a2-ce9101ef4836 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:00.297678 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfabdb7d-bb2f-4f5b-b2a2-ce9101ef4836 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:00.298385 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfabdb7d-bb2f-4f5b-b2a2-ce9101ef4836 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:00.300187 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfabdb7d-bb2f-4f5b-b2a2-ce9101ef4836 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:00.300854 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfabdb7d-bb2f-4f5b-b2a2-ce9101ef4836 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:00.301720 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfabdb7d-bb2f-4f5b-b2a2-ce9101ef4836 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:00.549717 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dfabdb7d-bb2f-4f5b-b2a2-ce9101ef4836 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:00.558420 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dfabdb7d-bb2f-4f5b-b2a2-ce9101ef4836 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:00.559944 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dfabdb7d-bb2f-4f5b-b2a2-ce9101ef4836 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:00.561096 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dfabdb7d-bb2f-4f5b-b2a2-ce9101ef4836 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.276052 Aug 18 14:29:00.561845 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 247/497] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:00 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:29:00.917605 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b25a116d-c73f-4dc3-b242-f109a691389a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:00.918218 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b25a116d-c73f-4dc3-b242-f109a691389a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:00.925108 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b25a116d-c73f-4dc3-b242-f109a691389a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:00.925582 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b25a116d-c73f-4dc3-b242-f109a691389a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:00.926016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b25a116d-c73f-4dc3-b242-f109a691389a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:00.926703 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b25a116d-c73f-4dc3-b242-f109a691389a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:00.927150 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b25a116d-c73f-4dc3-b242-f109a691389a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:00.927593 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b25a116d-c73f-4dc3-b242-f109a691389a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:00.987112 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-26fb013f-f1e7-4def-83db-177564f8f638 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:00.987948 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-26fb013f-f1e7-4def-83db-177564f8f638 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:00.997234 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26fb013f-f1e7-4def-83db-177564f8f638 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:00.997720 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26fb013f-f1e7-4def-83db-177564f8f638 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:00.998151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26fb013f-f1e7-4def-83db-177564f8f638 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:00.998882 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26fb013f-f1e7-4def-83db-177564f8f638 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:00.999336 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26fb013f-f1e7-4def-83db-177564f8f638 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:00.999911 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26fb013f-f1e7-4def-83db-177564f8f638 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:01.072274 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b25a116d-c73f-4dc3-b242-f109a691389a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:01.079973 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b25a116d-c73f-4dc3-b242-f109a691389a tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1318 microversion: 2.1 time: 0.166219 Aug 18 14:29:01.081227 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 251/498] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:00 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:01.085977 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-69f0bc7f-340e-4938-b987-4cd37fecd2ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:01.086578 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-69f0bc7f-340e-4938-b987-4cd37fecd2ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:01.092942 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-69f0bc7f-340e-4938-b987-4cd37fecd2ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:01.093630 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-69f0bc7f-340e-4938-b987-4cd37fecd2ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:01.094208 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-69f0bc7f-340e-4938-b987-4cd37fecd2ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:01.095059 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-69f0bc7f-340e-4938-b987-4cd37fecd2ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:01.095540 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-69f0bc7f-340e-4938-b987-4cd37fecd2ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:01.096041 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-69f0bc7f-340e-4938-b987-4cd37fecd2ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:01.109487 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-69f0bc7f-340e-4938-b987-4cd37fecd2ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-69f0bc7f-340e-4938-b987-4cd37fecd2ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f HTTP/1.1 Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:29:01.111151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:29:01.112777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:29:01.112777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:29:01.112777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:29:01.112777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:29:01.112777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:29:01.112777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:29:01.112777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:29:01.112777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:29:01.112777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:29:01.112777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:29:01.112777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:29:01.112777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': 'ed05a0ad-3aad-4113-b8b3-8daa97e04f2f'} Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:29:01.117297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:29:01.118844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:29:01.120384 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-69f0bc7f-340e-4938-b987-4cd37fecd2ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 404 to user: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:29:01.120384 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-69f0bc7f-340e-4938-b987-4cd37fecd2ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 404 len: 111 microversion: 2.1 time: 0.030447 Aug 18 14:29:01.120384 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 252/499] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:01 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:29:01.124593 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fee391dd-ef15-4561-90c3-c0a824fa4c45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '.version_select at 0x7fb62204adc0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:01.145480 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fee391dd-ef15-4561-90c3-c0a824fa4c45 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128760775" status: 202 len: 0 microversion: 2.1 time: 0.027034 Aug 18 14:29:01.146147 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 253/500] 10.222.0.39 () {58 vars in 1221 bytes} [Thu Aug 18 14:29:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128760775 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:29:01.266997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26fb013f-f1e7-4def-83db-177564f8f638 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:01.277976 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-26fb013f-f1e7-4def-83db-177564f8f638 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.296652 Aug 18 14:29:01.278666 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 248/501] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:00 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:29:01.584879 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ee5fb704-eef9-4c68-9d39-f09d0989abb8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:01.585412 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ee5fb704-eef9-4c68-9d39-f09d0989abb8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:01.592100 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee5fb704-eef9-4c68-9d39-f09d0989abb8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:01.592593 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee5fb704-eef9-4c68-9d39-f09d0989abb8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:01.593294 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee5fb704-eef9-4c68-9d39-f09d0989abb8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:01.594000 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee5fb704-eef9-4c68-9d39-f09d0989abb8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:01.594468 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee5fb704-eef9-4c68-9d39-f09d0989abb8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:01.594953 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee5fb704-eef9-4c68-9d39-f09d0989abb8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:01.665315 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-e79db871-442b-4e72-958f-67228e0dfb69 req-5ed8aa36-e53f-4e60-b6d0-5f20fb9ea915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e046c2-e6e7-4813-beae-dc4741a95675", "tag": "4730a8e9-144a-4cdc-8c06-f7e344938e02"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:29:01.678075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e79db871-442b-4e72-958f-67228e0dfb69 req-5ed8aa36-e53f-4e60-b6d0-5f20fb9ea915 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:01.678832 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e79db871-442b-4e72-958f-67228e0dfb69 req-5ed8aa36-e53f-4e60-b6d0-5f20fb9ea915 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:01.679471 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e79db871-442b-4e72-958f-67228e0dfb69 req-5ed8aa36-e53f-4e60-b6d0-5f20fb9ea915 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:01.697796 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-e79db871-442b-4e72-958f-67228e0dfb69 req-5ed8aa36-e53f-4e60-b6d0-5f20fb9ea915 service nova] Creating event network-changed:4730a8e9-144a-4cdc-8c06-f7e344938e02 for instance c5e046c2-e6e7-4813-beae-dc4741a95675 on hv-cinder-85220 Aug 18 14:29:01.710347 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-e79db871-442b-4e72-958f-67228e0dfb69 req-5ed8aa36-e53f-4e60-b6d0-5f20fb9ea915 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049520 Aug 18 14:29:01.712139 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 249/502] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:29:01.787087 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ee5fb704-eef9-4c68-9d39-f09d0989abb8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:01.797431 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ee5fb704-eef9-4c68-9d39-f09d0989abb8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:01.798971 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ee5fb704-eef9-4c68-9d39-f09d0989abb8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:01.800921 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ee5fb704-eef9-4c68-9d39-f09d0989abb8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.220125 Aug 18 14:29:01.801726 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 254/503] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:01 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:29:01.916678 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-94d52404-de04-4bfa-a1c0-0f796200c366 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Action: 'create', calling method: .version_select at 0x7fb6229961f0>, body: {"keypair": {"name": "tempest-keypair-411773349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxFoLM/25OZ3grXYKvfj27ZmEYv9DlWt/dYG48w7scRxj+bcT0kWLYMtxGlz12NVELw7dmmKneseqS4mPQfLwSgWpfBkvwyekZETe+wHFpyio3P6XJflzKutUxzJIgU7w=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:29:01.934282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-94d52404-de04-4bfa-a1c0-0f796200c366 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:29:01.938169 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-94d52404-de04-4bfa-a1c0-0f796200c366 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for user 5972d1e96fa04d52983ac6f201d7772c and project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:29:01.960785 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-94d52404-de04-4bfa-a1c0-0f796200c366 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048415 Aug 18 14:29:01.961457 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 250/504] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Aug 18 14:29:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:29:02.101690 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2d0ad188-9327-449a-8a8e-0c5b9122b0b5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:02.102415 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2d0ad188-9327-449a-8a8e-0c5b9122b0b5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:02.109109 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d0ad188-9327-449a-8a8e-0c5b9122b0b5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:02.109600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d0ad188-9327-449a-8a8e-0c5b9122b0b5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:02.110066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d0ad188-9327-449a-8a8e-0c5b9122b0b5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:02.110767 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d0ad188-9327-449a-8a8e-0c5b9122b0b5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:02.111226 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d0ad188-9327-449a-8a8e-0c5b9122b0b5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:02.111716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d0ad188-9327-449a-8a8e-0c5b9122b0b5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:02.250571 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2d0ad188-9327-449a-8a8e-0c5b9122b0b5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:02.259175 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2d0ad188-9327-449a-8a8e-0c5b9122b0b5 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1318 microversion: 2.1 time: 0.161487 Aug 18 14:29:02.259760 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 255/505] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:02 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:02.300411 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0510ba86-a798-415a-af26-f9227a130ae6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:02.301609 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0510ba86-a798-415a-af26-f9227a130ae6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:02.313206 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0510ba86-a798-415a-af26-f9227a130ae6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:02.313883 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0510ba86-a798-415a-af26-f9227a130ae6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:02.314327 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0510ba86-a798-415a-af26-f9227a130ae6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:02.316462 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0510ba86-a798-415a-af26-f9227a130ae6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:02.316933 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0510ba86-a798-415a-af26-f9227a130ae6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:02.317362 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0510ba86-a798-415a-af26-f9227a130ae6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:02.517484 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0510ba86-a798-415a-af26-f9227a130ae6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:02.526359 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0510ba86-a798-415a-af26-f9227a130ae6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.231097 Aug 18 14:29:02.527012 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 251/506] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:02 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:02.827643 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0df7ba0d-78bd-4032-a02a-1e9e056021c3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:02.828269 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0df7ba0d-78bd-4032-a02a-1e9e056021c3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:02.835636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0df7ba0d-78bd-4032-a02a-1e9e056021c3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:02.836142 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0df7ba0d-78bd-4032-a02a-1e9e056021c3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:02.836589 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0df7ba0d-78bd-4032-a02a-1e9e056021c3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:02.837304 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0df7ba0d-78bd-4032-a02a-1e9e056021c3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:02.837763 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0df7ba0d-78bd-4032-a02a-1e9e056021c3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:02.838200 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0df7ba0d-78bd-4032-a02a-1e9e056021c3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:02.856971 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:29:03.166696 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0df7ba0d-78bd-4032-a02a-1e9e056021c3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:03.179746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0df7ba0d-78bd-4032-a02a-1e9e056021c3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:03.181820 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0df7ba0d-78bd-4032-a02a-1e9e056021c3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:03.183504 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0df7ba0d-78bd-4032-a02a-1e9e056021c3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.359600 Aug 18 14:29:03.184390 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 256/507] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:02 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:29:03.294625 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-59beeed0-3b8a-4304-981b-3d8cf64e0ad8 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:03.296256 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-59beeed0-3b8a-4304-981b-3d8cf64e0ad8 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:03.305976 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-59beeed0-3b8a-4304-981b-3d8cf64e0ad8 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:03.307793 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-59beeed0-3b8a-4304-981b-3d8cf64e0ad8 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:03.308409 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-59beeed0-3b8a-4304-981b-3d8cf64e0ad8 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:03.310045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-59beeed0-3b8a-4304-981b-3d8cf64e0ad8 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:03.310680 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-59beeed0-3b8a-4304-981b-3d8cf64e0ad8 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:03.311392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-59beeed0-3b8a-4304-981b-3d8cf64e0ad8 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:03.548805 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-67d38e27-25a4-4443-b1d8-06d1022a5bd3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:03.549637 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-67d38e27-25a4-4443-b1d8-06d1022a5bd3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:03.555924 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d38e27-25a4-4443-b1d8-06d1022a5bd3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:03.557058 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d38e27-25a4-4443-b1d8-06d1022a5bd3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:03.557621 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d38e27-25a4-4443-b1d8-06d1022a5bd3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:03.558542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d38e27-25a4-4443-b1d8-06d1022a5bd3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:03.559203 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d38e27-25a4-4443-b1d8-06d1022a5bd3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:03.559747 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d38e27-25a4-4443-b1d8-06d1022a5bd3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:03.732628 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-59beeed0-3b8a-4304-981b-3d8cf64e0ad8 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:03.762942 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-67d38e27-25a4-4443-b1d8-06d1022a5bd3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:03.782001 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-67d38e27-25a4-4443-b1d8-06d1022a5bd3 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.237067 Aug 18 14:29:03.789669 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-59beeed0-3b8a-4304-981b-3d8cf64e0ad8 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1318 microversion: 2.1 time: 0.511563 Aug 18 14:29:03.792217 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 252/508] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:03 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:03.796026 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 257/509] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:03 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:29:03.881725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-952506491", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce7c320a-581c-4aa3-85bd-1646d1f4ed3c"}], "security_groups": [{"name": "tempest-securitygroup--464388396"}], "key_name": "tempest-keypair-411773349", "user_data": "}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:29:03.996823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] validate_networks() for [('ce7c320a-581c-4aa3-85bd-1646d1f4ed3c', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:29:04.206336 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-17066cb2-352a-4ab4-bcbc-ac5d8414e516 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:04.206947 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-17066cb2-352a-4ab4-bcbc-ac5d8414e516 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:04.213040 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17066cb2-352a-4ab4-bcbc-ac5d8414e516 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:04.213522 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17066cb2-352a-4ab4-bcbc-ac5d8414e516 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:04.213954 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17066cb2-352a-4ab4-bcbc-ac5d8414e516 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:04.214636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17066cb2-352a-4ab4-bcbc-ac5d8414e516 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:04.215086 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17066cb2-352a-4ab4-bcbc-ac5d8414e516 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:04.215548 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17066cb2-352a-4ab4-bcbc-ac5d8414e516 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:04.358729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-17066cb2-352a-4ab4-bcbc-ac5d8414e516 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:04.368479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-17066cb2-352a-4ab4-bcbc-ac5d8414e516 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:04.370165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-17066cb2-352a-4ab4-bcbc-ac5d8414e516 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:04.371446 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-17066cb2-352a-4ab4-bcbc-ac5d8414e516 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.169330 Aug 18 14:29:04.372090 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 258/510] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:04 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:29:04.372475 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:29:04.372983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:29:04.373468 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:29:04.373895 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:29:04.374305 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:29:04.383317 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:04.383825 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:04.384258 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:04.384976 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:04.385422 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:04.385840 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:04.402616 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:29:04.406524 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for user 5972d1e96fa04d52983ac6f201d7772c and project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:29:04.418404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:29:04.420931 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:29:04.468740 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-21e17b30-d406-472d-a907-371f8c012ef5 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.592398 Aug 18 14:29:04.469378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 253/511] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:29:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:29:04.480520 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0a7dd9c9-9a39-448c-b91d-7375ee6ad496 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:04.481211 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0a7dd9c9-9a39-448c-b91d-7375ee6ad496 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:04.535526 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0a7dd9c9-9a39-448c-b91d-7375ee6ad496 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:04.542448 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0a7dd9c9-9a39-448c-b91d-7375ee6ad496 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1240 microversion: 2.1 time: 0.065731 Aug 18 14:29:04.543043 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 259/512] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:04 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:04.808772 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4a9f976e-0dd6-4969-a210-0c00682600ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:04.812103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4a9f976e-0dd6-4969-a210-0c00682600ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:04.814132 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8c04b1f4-0387-4aa5-8442-71637d2b4c97 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:04.815307 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8c04b1f4-0387-4aa5-8442-71637d2b4c97 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:04.819432 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a9f976e-0dd6-4969-a210-0c00682600ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:04.819833 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a9f976e-0dd6-4969-a210-0c00682600ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:04.820271 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a9f976e-0dd6-4969-a210-0c00682600ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:04.821309 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a9f976e-0dd6-4969-a210-0c00682600ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:04.821554 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c04b1f4-0387-4aa5-8442-71637d2b4c97 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:04.821772 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a9f976e-0dd6-4969-a210-0c00682600ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:04.822028 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c04b1f4-0387-4aa5-8442-71637d2b4c97 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:04.822393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a9f976e-0dd6-4969-a210-0c00682600ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:04.822622 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c04b1f4-0387-4aa5-8442-71637d2b4c97 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:04.823534 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c04b1f4-0387-4aa5-8442-71637d2b4c97 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:04.823991 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c04b1f4-0387-4aa5-8442-71637d2b4c97 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:04.824420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c04b1f4-0387-4aa5-8442-71637d2b4c97 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:04.958622 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4a9f976e-0dd6-4969-a210-0c00682600ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:04.964978 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8c04b1f4-0387-4aa5-8442-71637d2b4c97 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:04.968472 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4a9f976e-0dd6-4969-a210-0c00682600ab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.163543 Aug 18 14:29:04.969052 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 254/513] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:04 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:04.974236 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8c04b1f4-0387-4aa5-8442-71637d2b4c97 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1318 microversion: 2.1 time: 0.164125 Aug 18 14:29:04.974794 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 260/514] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:04 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:05.310078 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-140aceeb-a2f8-4d03-b5da-b026de625416 req-8be724ec-0431-4f27-88a5-8995f91caaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e046c2-e6e7-4813-beae-dc4741a95675", "name": "network-vif-plugged", "status": "completed", "tag": "4730a8e9-144a-4cdc-8c06-f7e344938e02"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:29:05.321529 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-140aceeb-a2f8-4d03-b5da-b026de625416 req-8be724ec-0431-4f27-88a5-8995f91caaea service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:05.322637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-140aceeb-a2f8-4d03-b5da-b026de625416 req-8be724ec-0431-4f27-88a5-8995f91caaea service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:05.323139 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-140aceeb-a2f8-4d03-b5da-b026de625416 req-8be724ec-0431-4f27-88a5-8995f91caaea service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:05.335017 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-140aceeb-a2f8-4d03-b5da-b026de625416 req-8be724ec-0431-4f27-88a5-8995f91caaea service nova] Creating event network-vif-plugged:4730a8e9-144a-4cdc-8c06-f7e344938e02 for instance c5e046c2-e6e7-4813-beae-dc4741a95675 on hv-cinder-85220 Aug 18 14:29:05.339996 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-140aceeb-a2f8-4d03-b5da-b026de625416 req-8be724ec-0431-4f27-88a5-8995f91caaea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033698 Aug 18 14:29:05.340585 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 255/515] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:29:05.395291 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-10bf204f-6fcc-4236-93b7-dec9065a001b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:05.395953 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-10bf204f-6fcc-4236-93b7-dec9065a001b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:05.402440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10bf204f-6fcc-4236-93b7-dec9065a001b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:05.402923 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10bf204f-6fcc-4236-93b7-dec9065a001b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:05.403361 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10bf204f-6fcc-4236-93b7-dec9065a001b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:05.404080 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10bf204f-6fcc-4236-93b7-dec9065a001b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:05.404536 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10bf204f-6fcc-4236-93b7-dec9065a001b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:05.404966 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10bf204f-6fcc-4236-93b7-dec9065a001b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:05.535257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-10bf204f-6fcc-4236-93b7-dec9065a001b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:05.543852 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-10bf204f-6fcc-4236-93b7-dec9065a001b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:05.545355 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-10bf204f-6fcc-4236-93b7-dec9065a001b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:05.546511 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-10bf204f-6fcc-4236-93b7-dec9065a001b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.155210 Aug 18 14:29:05.547063 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 261/516] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:05 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:29:05.563746 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d2053414-a9f8-4416-92c3-c53dd0714e30 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:05.564552 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d2053414-a9f8-4416-92c3-c53dd0714e30 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:05.570878 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2053414-a9f8-4416-92c3-c53dd0714e30 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:05.571351 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2053414-a9f8-4416-92c3-c53dd0714e30 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:05.571935 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2053414-a9f8-4416-92c3-c53dd0714e30 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:05.572623 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2053414-a9f8-4416-92c3-c53dd0714e30 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:05.573069 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2053414-a9f8-4416-92c3-c53dd0714e30 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:05.573490 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2053414-a9f8-4416-92c3-c53dd0714e30 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:05.634890 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d2053414-a9f8-4416-92c3-c53dd0714e30 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:05.642385 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d2053414-a9f8-4416-92c3-c53dd0714e30 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1244 microversion: 2.1 time: 0.082893 Aug 18 14:29:05.643049 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 256/517] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:05 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:05.989827 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b5b6eb06-3353-483f-ad15-daa89ebc5461 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:05.990435 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b5b6eb06-3353-483f-ad15-daa89ebc5461 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:05.993730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0620e169-49bc-4da8-83b2-0b0850fad994 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:05.994351 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0620e169-49bc-4da8-83b2-0b0850fad994 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:05.996383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5b6eb06-3353-483f-ad15-daa89ebc5461 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:05.996928 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5b6eb06-3353-483f-ad15-daa89ebc5461 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:05.997365 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5b6eb06-3353-483f-ad15-daa89ebc5461 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:05.998048 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5b6eb06-3353-483f-ad15-daa89ebc5461 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:05.998519 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5b6eb06-3353-483f-ad15-daa89ebc5461 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:05.998941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5b6eb06-3353-483f-ad15-daa89ebc5461 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:06.000750 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0620e169-49bc-4da8-83b2-0b0850fad994 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:06.001235 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0620e169-49bc-4da8-83b2-0b0850fad994 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:06.001674 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0620e169-49bc-4da8-83b2-0b0850fad994 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:06.002375 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0620e169-49bc-4da8-83b2-0b0850fad994 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:06.002825 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0620e169-49bc-4da8-83b2-0b0850fad994 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:06.003250 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0620e169-49bc-4da8-83b2-0b0850fad994 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:06.128298 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b5b6eb06-3353-483f-ad15-daa89ebc5461 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:06.136541 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b5b6eb06-3353-483f-ad15-daa89ebc5461 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.150517 Aug 18 14:29:06.137130 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 262/518] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:05 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:06.138429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0620e169-49bc-4da8-83b2-0b0850fad994 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:06.147435 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0620e169-49bc-4da8-83b2-0b0850fad994 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1318 microversion: 2.1 time: 0.157444 Aug 18 14:29:06.148154 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 257/519] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:05 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:29:06.569983 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7f9bc626-4ca3-4f62-907e-d4da79f78c31 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:06.570596 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7f9bc626-4ca3-4f62-907e-d4da79f78c31 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:06.578493 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f9bc626-4ca3-4f62-907e-d4da79f78c31 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:06.579085 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f9bc626-4ca3-4f62-907e-d4da79f78c31 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:06.579809 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f9bc626-4ca3-4f62-907e-d4da79f78c31 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:06.580687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f9bc626-4ca3-4f62-907e-d4da79f78c31 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:06.581923 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f9bc626-4ca3-4f62-907e-d4da79f78c31 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:06.582363 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f9bc626-4ca3-4f62-907e-d4da79f78c31 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:06.667133 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-20d9d0a8-1dfd-438a-8810-6bf69e5b8510 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:06.668007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-20d9d0a8-1dfd-438a-8810-6bf69e5b8510 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:06.678859 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20d9d0a8-1dfd-438a-8810-6bf69e5b8510 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:06.679502 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20d9d0a8-1dfd-438a-8810-6bf69e5b8510 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:06.680015 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20d9d0a8-1dfd-438a-8810-6bf69e5b8510 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:06.680842 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20d9d0a8-1dfd-438a-8810-6bf69e5b8510 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:06.681378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20d9d0a8-1dfd-438a-8810-6bf69e5b8510 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:06.681862 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20d9d0a8-1dfd-438a-8810-6bf69e5b8510 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:06.745084 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-20d9d0a8-1dfd-438a-8810-6bf69e5b8510 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:06.752839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-20d9d0a8-1dfd-438a-8810-6bf69e5b8510 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1292 microversion: 2.1 time: 0.090329 Aug 18 14:29:06.753418 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 258/520] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:06 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:06.755201 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7f9bc626-4ca3-4f62-907e-d4da79f78c31 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:06.763928 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7f9bc626-4ca3-4f62-907e-d4da79f78c31 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:06.765415 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7f9bc626-4ca3-4f62-907e-d4da79f78c31 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:06.766558 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7f9bc626-4ca3-4f62-907e-d4da79f78c31 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.200543 Aug 18 14:29:06.767104 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 263/521] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:06 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:29:07.158460 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a03c174e-a414-4f03-94b0-00045e4f8530 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:07.159159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a03c174e-a414-4f03-94b0-00045e4f8530 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:07.165865 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a03c174e-a414-4f03-94b0-00045e4f8530 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:07.166361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a03c174e-a414-4f03-94b0-00045e4f8530 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:07.166805 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a03c174e-a414-4f03-94b0-00045e4f8530 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:07.167544 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a03c174e-a414-4f03-94b0-00045e4f8530 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:07.168006 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a03c174e-a414-4f03-94b0-00045e4f8530 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:07.168581 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a03c174e-a414-4f03-94b0-00045e4f8530 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:07.169368 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-aa5f66fd-6a16-4322-a479-9c6ab015b784 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:07.169996 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-aa5f66fd-6a16-4322-a479-9c6ab015b784 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:07.176414 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa5f66fd-6a16-4322-a479-9c6ab015b784 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:07.176908 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa5f66fd-6a16-4322-a479-9c6ab015b784 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:07.177349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa5f66fd-6a16-4322-a479-9c6ab015b784 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:07.178046 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa5f66fd-6a16-4322-a479-9c6ab015b784 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:07.178507 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa5f66fd-6a16-4322-a479-9c6ab015b784 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:07.179127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa5f66fd-6a16-4322-a479-9c6ab015b784 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:07.315450 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a03c174e-a414-4f03-94b0-00045e4f8530 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:07.324779 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a03c174e-a414-4f03-94b0-00045e4f8530 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1731 microversion: 2.1 time: 0.170231 Aug 18 14:29:07.335455 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 259/522] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:07 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:29:07.335683 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aa5f66fd-6a16-4322-a479-9c6ab015b784 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:07.338112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-aa5f66fd-6a16-4322-a479-9c6ab015b784 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1318 microversion: 2.1 time: 0.173602 Aug 18 14:29:07.351644 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 264/523] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:07 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:29:07.773885 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-148b2ba2-e58a-4f65-be6d-bd5c20f19c8b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:07.774526 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-148b2ba2-e58a-4f65-be6d-bd5c20f19c8b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:07.780529 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-148b2ba2-e58a-4f65-be6d-bd5c20f19c8b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:07.781007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-148b2ba2-e58a-4f65-be6d-bd5c20f19c8b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:07.781439 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-148b2ba2-e58a-4f65-be6d-bd5c20f19c8b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:07.782116 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-148b2ba2-e58a-4f65-be6d-bd5c20f19c8b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:07.782563 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-148b2ba2-e58a-4f65-be6d-bd5c20f19c8b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:07.782982 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-148b2ba2-e58a-4f65-be6d-bd5c20f19c8b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:07.790283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c85bdb0c-d92b-4213-8519-6e85541b46f3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:07.790894 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c85bdb0c-d92b-4213-8519-6e85541b46f3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:07.797265 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c85bdb0c-d92b-4213-8519-6e85541b46f3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:07.797757 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c85bdb0c-d92b-4213-8519-6e85541b46f3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:07.798191 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c85bdb0c-d92b-4213-8519-6e85541b46f3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:07.798926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c85bdb0c-d92b-4213-8519-6e85541b46f3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:07.799492 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c85bdb0c-d92b-4213-8519-6e85541b46f3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:07.799813 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c85bdb0c-d92b-4213-8519-6e85541b46f3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:07.849502 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-148b2ba2-e58a-4f65-be6d-bd5c20f19c8b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:07.857125 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-148b2ba2-e58a-4f65-be6d-bd5c20f19c8b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1300 microversion: 2.1 time: 0.087054 Aug 18 14:29:07.857881 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 260/524] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:07 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:07.990995 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c85bdb0c-d92b-4213-8519-6e85541b46f3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:08.004567 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c85bdb0c-d92b-4213-8519-6e85541b46f3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:08.006065 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c85bdb0c-d92b-4213-8519-6e85541b46f3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:08.020003 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c85bdb0c-d92b-4213-8519-6e85541b46f3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.233369 Aug 18 14:29:08.042232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 265/525] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:07 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:29:08.352357 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f9f3115-99b3-4306-845a-190a01e40ade tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:08.352967 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4f9f3115-99b3-4306-845a-190a01e40ade tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:08.359854 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f9f3115-99b3-4306-845a-190a01e40ade tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:08.360336 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f9f3115-99b3-4306-845a-190a01e40ade tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:08.360563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d956b598-f361-4d9f-809e-1d86a0b6419c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:08.360763 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f9f3115-99b3-4306-845a-190a01e40ade tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:08.361184 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d956b598-f361-4d9f-809e-1d86a0b6419c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:08.361484 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f9f3115-99b3-4306-845a-190a01e40ade tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:08.361935 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f9f3115-99b3-4306-845a-190a01e40ade tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:08.362361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f9f3115-99b3-4306-845a-190a01e40ade tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:08.367125 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d956b598-f361-4d9f-809e-1d86a0b6419c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:08.367653 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d956b598-f361-4d9f-809e-1d86a0b6419c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:08.368091 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d956b598-f361-4d9f-809e-1d86a0b6419c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:08.368783 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d956b598-f361-4d9f-809e-1d86a0b6419c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:08.369236 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d956b598-f361-4d9f-809e-1d86a0b6419c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:08.369660 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d956b598-f361-4d9f-809e-1d86a0b6419c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:08.499343 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4f9f3115-99b3-4306-845a-190a01e40ade tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:08.502445 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d956b598-f361-4d9f-809e-1d86a0b6419c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:08.507975 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f9f3115-99b3-4306-845a-190a01e40ade tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1711 microversion: 2.1 time: 0.159345 Aug 18 14:29:08.508747 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 261/526] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:08 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:08.511229 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d956b598-f361-4d9f-809e-1d86a0b6419c tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1318 microversion: 2.1 time: 0.154424 Aug 18 14:29:08.512233 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 266/527] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:08 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:08.631678 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a001ab6f-2afb-4f1f-ac5a-f808f612f306 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:08.632483 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a001ab6f-2afb-4f1f-ac5a-f808f612f306 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:08.638457 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a001ab6f-2afb-4f1f-ac5a-f808f612f306 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:08.638940 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a001ab6f-2afb-4f1f-ac5a-f808f612f306 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:08.639392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a001ab6f-2afb-4f1f-ac5a-f808f612f306 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:08.640087 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a001ab6f-2afb-4f1f-ac5a-f808f612f306 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:08.640533 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a001ab6f-2afb-4f1f-ac5a-f808f612f306 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:08.640953 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a001ab6f-2afb-4f1f-ac5a-f808f612f306 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:08.766500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-a001ab6f-2afb-4f1f-ac5a-f808f612f306 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] HTTP exception thrown: Cannot 'detach_volume' instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 while it is in vm_state rescued Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a001ab6f-2afb-4f1f-ac5a-f808f612f306 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Request method failure captured: Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-volume_attachments/cd6f466c-a23c-4dac-8f27-472d6d8f9da1 HTTP/1.1 Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvDrlAzVmK2YGq_eda07azj0Q5wXK5WMqshAENCB_sdiRt9OENbPVNax3o1QeEbjwKoARV5nzkWWp3C1qz5fFGCEUdhnGLYo5jhlagdb1rEhpPqpOmG3k-UOWefsZlXkDNPL-7u5L9-Nt41h7CA3ghNp-8pAcB0qSc9vAvc1V_hPkw Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: e39a8bb94bfb417b951e4f66473fa900 Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:29:08.768729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:29:08.770155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:29:08.770155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:29:08.770155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: e39a8bb94bfb417b951e4f66473fa900 Aug 18 14:29:08.770155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:29:08.770155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-ServerRescueNegativeTestJSON-127563257-project Aug 18 14:29:08.770155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:29:08.770155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:29:08.770155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 12e95dabd6f04cd9818a77f27b34d927 Aug 18 14:29:08.770155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-127563257-project Aug 18 14:29:08.770155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:29:08.770155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Cannot 'detach_volume' instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 while it is in vm_state rescued Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'server_id': '62e4b5fa-03a1-40fd-b4e4-89152f368dc9', 'id': 'cd6f466c-a23c-4dac-8f27-472d6d8f9da1'} Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:29:08.770822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 while it is in vm_state rescued Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 while it is in vm_state rescued Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:29:08.772059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a001ab6f-2afb-4f1f-ac5a-f808f612f306 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Returning 409 to user: Cannot 'detach_volume' instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 while it is in vm_state rescued {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:29:08.773039 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a001ab6f-2afb-4f1f-ac5a-f808f612f306 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "DELETE /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-volume_attachments/cd6f466c-a23c-4dac-8f27-472d6d8f9da1" status: 409 len: 152 microversion: 2.1 time: 0.143693 Aug 18 14:29:08.773039 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 262/528] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Aug 18 14:29:08 2022] DELETE /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-volume_attachments/cd6f466c-a23c-4dac-8f27-472d6d8f9da1 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 14:29:08.779072 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-62c4368a-007d-44e1-a7e8-361955308d5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:29:08.779714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-62c4368a-007d-44e1-a7e8-361955308d5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:08.786112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62c4368a-007d-44e1-a7e8-361955308d5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:08.786606 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62c4368a-007d-44e1-a7e8-361955308d5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:08.787041 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62c4368a-007d-44e1-a7e8-361955308d5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:08.787758 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62c4368a-007d-44e1-a7e8-361955308d5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:08.788241 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62c4368a-007d-44e1-a7e8-361955308d5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:08.788692 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62c4368a-007d-44e1-a7e8-361955308d5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:08.854021 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-62c4368a-007d-44e1-a7e8-361955308d5a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "POST /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/action" status: 202 len: 0 microversion: 2.1 time: 0.078595 Aug 18 14:29:08.854704 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 267/529] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:29:08 2022] POST /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:29:08.863811 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d5eb4fe6-ca11-48bb-b54e-edae6737876a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:08.864446 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d5eb4fe6-ca11-48bb-b54e-edae6737876a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:08.871084 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5eb4fe6-ca11-48bb-b54e-edae6737876a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:08.871603 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5eb4fe6-ca11-48bb-b54e-edae6737876a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:08.872095 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5eb4fe6-ca11-48bb-b54e-edae6737876a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:08.872743 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5eb4fe6-ca11-48bb-b54e-edae6737876a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:08.873196 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5eb4fe6-ca11-48bb-b54e-edae6737876a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:08.873619 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5eb4fe6-ca11-48bb-b54e-edae6737876a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:08.878284 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fb151504-48c4-46ad-85d4-2562acfe4a74 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:08.878986 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fb151504-48c4-46ad-85d4-2562acfe4a74 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:08.884975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb151504-48c4-46ad-85d4-2562acfe4a74 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:08.885452 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb151504-48c4-46ad-85d4-2562acfe4a74 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:08.885883 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb151504-48c4-46ad-85d4-2562acfe4a74 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:08.886561 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb151504-48c4-46ad-85d4-2562acfe4a74 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:08.887011 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb151504-48c4-46ad-85d4-2562acfe4a74 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:08.887459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb151504-48c4-46ad-85d4-2562acfe4a74 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:08.950265 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fb151504-48c4-46ad-85d4-2562acfe4a74 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:08.958982 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fb151504-48c4-46ad-85d4-2562acfe4a74 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1298 microversion: 2.1 time: 0.084837 Aug 18 14:29:08.959587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 268/530] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:08 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:29:09.006076 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d5eb4fe6-ca11-48bb-b54e-edae6737876a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:09.016501 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d5eb4fe6-ca11-48bb-b54e-edae6737876a tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1719 microversion: 2.1 time: 0.157358 Aug 18 14:29:09.017075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 263/531] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:08 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:09.048412 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-59af0628-0cc5-4601-a437-4c28ecd55075 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:09.049942 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-59af0628-0cc5-4601-a437-4c28ecd55075 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:09.057889 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59af0628-0cc5-4601-a437-4c28ecd55075 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:09.058398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59af0628-0cc5-4601-a437-4c28ecd55075 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:09.058830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59af0628-0cc5-4601-a437-4c28ecd55075 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:09.059580 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59af0628-0cc5-4601-a437-4c28ecd55075 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:09.060056 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59af0628-0cc5-4601-a437-4c28ecd55075 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:09.060487 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59af0628-0cc5-4601-a437-4c28ecd55075 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:09.340627 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-1f650079-1b07-4f7b-bbb8-ae635319b58d req-15a6afc1-b3f7-4586-b25d-97270a36e6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d09be0-5622-4167-859a-c81e38fc7218", "name": "network-vif-plugged", "status": "completed", "tag": "ce6e4f0c-73f1-4b80-9e83-e467ad9ba266"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:29:09.363271 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-59af0628-0cc5-4601-a437-4c28ecd55075 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:09.374759 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-59af0628-0cc5-4601-a437-4c28ecd55075 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:09.375109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1f650079-1b07-4f7b-bbb8-ae635319b58d req-15a6afc1-b3f7-4586-b25d-97270a36e6c9 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:09.375645 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1f650079-1b07-4f7b-bbb8-ae635319b58d req-15a6afc1-b3f7-4586-b25d-97270a36e6c9 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:09.376127 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1f650079-1b07-4f7b-bbb8-ae635319b58d req-15a6afc1-b3f7-4586-b25d-97270a36e6c9 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:09.382167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-59af0628-0cc5-4601-a437-4c28ecd55075 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:09.383404 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-59af0628-0cc5-4601-a437-4c28ecd55075 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.340625 Aug 18 14:29:09.383959 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 269/532] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:09 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:29:09.394225 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-1f650079-1b07-4f7b-bbb8-ae635319b58d req-15a6afc1-b3f7-4586-b25d-97270a36e6c9 service nova] Creating event network-vif-plugged:ce6e4f0c-73f1-4b80-9e83-e467ad9ba266 for instance 95d09be0-5622-4167-859a-c81e38fc7218 on hv-cinder-85220 Aug 18 14:29:09.399494 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-1f650079-1b07-4f7b-bbb8-ae635319b58d req-15a6afc1-b3f7-4586-b25d-97270a36e6c9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067830 Aug 18 14:29:09.400981 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 264/533] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:29:09.532470 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cff60601-a978-4a1c-b546-4424bd68d9a4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:09.533203 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cff60601-a978-4a1c-b546-4424bd68d9a4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:09.539357 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cff60601-a978-4a1c-b546-4424bd68d9a4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:09.539892 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cff60601-a978-4a1c-b546-4424bd68d9a4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:09.540335 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cff60601-a978-4a1c-b546-4424bd68d9a4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:09.541029 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cff60601-a978-4a1c-b546-4424bd68d9a4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:09.541488 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cff60601-a978-4a1c-b546-4424bd68d9a4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:09.541919 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cff60601-a978-4a1c-b546-4424bd68d9a4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:09.801044 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cff60601-a978-4a1c-b546-4424bd68d9a4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:09.811892 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cff60601-a978-4a1c-b546-4424bd68d9a4 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1507 microversion: 2.1 time: 0.283189 Aug 18 14:29:09.812745 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 270/534] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:09 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1507 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:09.835872 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b862f005-8847-4ef9-ad1f-b28d93cc6831 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db61e0cc-2798-4298-84db-167fa0c4e8dc", "device": "/dev/sdb"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:29:09.839767 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b862f005-8847-4ef9-ad1f-b28d93cc6831 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:09.846485 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b862f005-8847-4ef9-ad1f-b28d93cc6831 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:09.846975 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b862f005-8847-4ef9-ad1f-b28d93cc6831 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:09.847496 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b862f005-8847-4ef9-ad1f-b28d93cc6831 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:09.848244 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b862f005-8847-4ef9-ad1f-b28d93cc6831 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:09.848705 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b862f005-8847-4ef9-ad1f-b28d93cc6831 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:09.849126 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b862f005-8847-4ef9-ad1f-b28d93cc6831 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:09.945836 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:29:09.981158 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1dd5373e-ca64-430c-ac29-f441de1f1084 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:09.982521 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1dd5373e-ca64-430c-ac29-f441de1f1084 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:09.989681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dd5373e-ca64-430c-ac29-f441de1f1084 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:09.991518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dd5373e-ca64-430c-ac29-f441de1f1084 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:09.992346 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dd5373e-ca64-430c-ac29-f441de1f1084 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:09.993732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dd5373e-ca64-430c-ac29-f441de1f1084 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:09.994410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dd5373e-ca64-430c-ac29-f441de1f1084 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:09.995231 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dd5373e-ca64-430c-ac29-f441de1f1084 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:10.263331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1dd5373e-ca64-430c-ac29-f441de1f1084 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:10.276794 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1dd5373e-ca64-430c-ac29-f441de1f1084 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1365 microversion: 2.1 time: 0.299298 Aug 18 14:29:10.277977 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 271/535] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:09 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:29:10.282655 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9b99523c-48f1-436c-89a9-cf7207c74fab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:10.288152 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9b99523c-48f1-436c-89a9-cf7207c74fab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:10.299444 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b99523c-48f1-436c-89a9-cf7207c74fab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:10.300447 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b99523c-48f1-436c-89a9-cf7207c74fab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:10.301084 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b99523c-48f1-436c-89a9-cf7207c74fab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:10.301998 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b99523c-48f1-436c-89a9-cf7207c74fab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:10.302636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b99523c-48f1-436c-89a9-cf7207c74fab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:10.303265 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b99523c-48f1-436c-89a9-cf7207c74fab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:10.400398 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b862f005-8847-4ef9-ad1f-b28d93cc6831 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "POST /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.569803 Aug 18 14:29:10.401307 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 265/536] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:29:09 2022] POST /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675/os-volume_attachments => generated 194 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:29:10.414277 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-81df551d-4a75-4e8a-be47-28ec53b5de76 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:10.415919 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-81df551d-4a75-4e8a-be47-28ec53b5de76 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:10.423692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81df551d-4a75-4e8a-be47-28ec53b5de76 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:10.425377 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81df551d-4a75-4e8a-be47-28ec53b5de76 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:10.425862 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81df551d-4a75-4e8a-be47-28ec53b5de76 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:10.426589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81df551d-4a75-4e8a-be47-28ec53b5de76 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:10.427050 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81df551d-4a75-4e8a-be47-28ec53b5de76 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:10.427593 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81df551d-4a75-4e8a-be47-28ec53b5de76 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:10.486552 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9b99523c-48f1-436c-89a9-cf7207c74fab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:10.494873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9b99523c-48f1-436c-89a9-cf7207c74fab tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1719 microversion: 2.1 time: 0.215770 Aug 18 14:29:10.495459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 272/537] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:10 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:10.575918 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81df551d-4a75-4e8a-be47-28ec53b5de76 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:10.585300 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81df551d-4a75-4e8a-be47-28ec53b5de76 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:10.586735 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81df551d-4a75-4e8a-be47-28ec53b5de76 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:10.587953 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-81df551d-4a75-4e8a-be47-28ec53b5de76 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.185748 Aug 18 14:29:10.588515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 266/538] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:10 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:29:11.087827 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-705e5259-712f-4dbc-9bde-b420a52ae77e req-fbac2f3d-ecd1-4f41-9101-3c0aa1e1dd76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee35547b-560b-4510-a182-aae686f38082", "tag": "436f8533-78b5-46d1-b635-ee6a7c8d2cbc"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:29:11.098306 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-705e5259-712f-4dbc-9bde-b420a52ae77e req-fbac2f3d-ecd1-4f41-9101-3c0aa1e1dd76 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:11.098728 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-705e5259-712f-4dbc-9bde-b420a52ae77e req-fbac2f3d-ecd1-4f41-9101-3c0aa1e1dd76 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:11.099164 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-705e5259-712f-4dbc-9bde-b420a52ae77e req-fbac2f3d-ecd1-4f41-9101-3c0aa1e1dd76 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:11.103008 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:29:11.110645 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-705e5259-712f-4dbc-9bde-b420a52ae77e req-fbac2f3d-ecd1-4f41-9101-3c0aa1e1dd76 service nova] Creating event network-changed:436f8533-78b5-46d1-b635-ee6a7c8d2cbc for instance ee35547b-560b-4510-a182-aae686f38082 on hv-cinder-85220 Aug 18 14:29:11.115407 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-705e5259-712f-4dbc-9bde-b420a52ae77e req-fbac2f3d-ecd1-4f41-9101-3c0aa1e1dd76 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031235 Aug 18 14:29:11.116176 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 273/539] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:29:11.299652 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-42cb1324-ce59-4066-9bf1-a2feeba66fa1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:11.300784 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-42cb1324-ce59-4066-9bf1-a2feeba66fa1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:11.307344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42cb1324-ce59-4066-9bf1-a2feeba66fa1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:11.307893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42cb1324-ce59-4066-9bf1-a2feeba66fa1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:11.308327 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42cb1324-ce59-4066-9bf1-a2feeba66fa1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:11.310103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42cb1324-ce59-4066-9bf1-a2feeba66fa1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:11.310571 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42cb1324-ce59-4066-9bf1-a2feeba66fa1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:11.310996 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42cb1324-ce59-4066-9bf1-a2feeba66fa1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:11.443407 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-42cb1324-ce59-4066-9bf1-a2feeba66fa1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:11.451105 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-42cb1324-ce59-4066-9bf1-a2feeba66fa1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1365 microversion: 2.1 time: 0.156682 Aug 18 14:29:11.451689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 267/540] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:11 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:11.516940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c6c89cc8-e7c7-4407-8f30-d19cfb0268c6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:11.517851 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c6c89cc8-e7c7-4407-8f30-d19cfb0268c6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:11.525239 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6c89cc8-e7c7-4407-8f30-d19cfb0268c6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:11.525726 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6c89cc8-e7c7-4407-8f30-d19cfb0268c6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:11.526159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6c89cc8-e7c7-4407-8f30-d19cfb0268c6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:11.526847 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6c89cc8-e7c7-4407-8f30-d19cfb0268c6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:11.527292 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6c89cc8-e7c7-4407-8f30-d19cfb0268c6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:11.527745 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6c89cc8-e7c7-4407-8f30-d19cfb0268c6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:11.611149 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-49bdd54b-ae96-44bc-9f1c-bafce6e2efea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:11.612579 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-49bdd54b-ae96-44bc-9f1c-bafce6e2efea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:11.618615 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49bdd54b-ae96-44bc-9f1c-bafce6e2efea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:11.619093 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49bdd54b-ae96-44bc-9f1c-bafce6e2efea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:11.619555 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49bdd54b-ae96-44bc-9f1c-bafce6e2efea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:11.620245 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49bdd54b-ae96-44bc-9f1c-bafce6e2efea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:11.620689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49bdd54b-ae96-44bc-9f1c-bafce6e2efea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:11.621108 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49bdd54b-ae96-44bc-9f1c-bafce6e2efea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:11.667845 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c6c89cc8-e7c7-4407-8f30-d19cfb0268c6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:11.676831 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c6c89cc8-e7c7-4407-8f30-d19cfb0268c6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1719 microversion: 2.1 time: 0.164528 Aug 18 14:29:11.677406 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 274/541] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:11 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:11.762177 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-49bdd54b-ae96-44bc-9f1c-bafce6e2efea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:11.771723 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-49bdd54b-ae96-44bc-9f1c-bafce6e2efea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:11.773206 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-49bdd54b-ae96-44bc-9f1c-bafce6e2efea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:11.774343 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-49bdd54b-ae96-44bc-9f1c-bafce6e2efea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.167157 Aug 18 14:29:11.774900 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 268/542] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:11 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:29:12.472908 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3490088b-5eec-4fe8-a820-fd14bd5136fa tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:12.473612 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3490088b-5eec-4fe8-a820-fd14bd5136fa tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:12.480081 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3490088b-5eec-4fe8-a820-fd14bd5136fa tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:12.480564 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3490088b-5eec-4fe8-a820-fd14bd5136fa tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:12.481001 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3490088b-5eec-4fe8-a820-fd14bd5136fa tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:12.481691 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3490088b-5eec-4fe8-a820-fd14bd5136fa tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:12.482145 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3490088b-5eec-4fe8-a820-fd14bd5136fa tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:12.482572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3490088b-5eec-4fe8-a820-fd14bd5136fa tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:12.684725 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3490088b-5eec-4fe8-a820-fd14bd5136fa tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:12.693730 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3490088b-5eec-4fe8-a820-fd14bd5136fa tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1365 microversion: 2.1 time: 0.225399 Aug 18 14:29:12.694933 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 275/543] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:12 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:12.698136 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aca00efe-6ba4-456e-b75e-8f8f8df9d344 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:12.698754 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aca00efe-6ba4-456e-b75e-8f8f8df9d344 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:12.706663 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aca00efe-6ba4-456e-b75e-8f8f8df9d344 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:12.707153 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aca00efe-6ba4-456e-b75e-8f8f8df9d344 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:12.707664 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aca00efe-6ba4-456e-b75e-8f8f8df9d344 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:12.708574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aca00efe-6ba4-456e-b75e-8f8f8df9d344 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:12.709011 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aca00efe-6ba4-456e-b75e-8f8f8df9d344 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:12.709792 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aca00efe-6ba4-456e-b75e-8f8f8df9d344 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:12.798855 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-92c1e669-78ab-4305-b483-f23d4d3ffe0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:12.799657 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-92c1e669-78ab-4305-b483-f23d4d3ffe0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:12.807688 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92c1e669-78ab-4305-b483-f23d4d3ffe0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:12.808600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92c1e669-78ab-4305-b483-f23d4d3ffe0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:12.809635 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92c1e669-78ab-4305-b483-f23d4d3ffe0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:12.811413 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92c1e669-78ab-4305-b483-f23d4d3ffe0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:12.812046 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92c1e669-78ab-4305-b483-f23d4d3ffe0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:12.812485 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92c1e669-78ab-4305-b483-f23d4d3ffe0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:12.857412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aca00efe-6ba4-456e-b75e-8f8f8df9d344 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:12.866903 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aca00efe-6ba4-456e-b75e-8f8f8df9d344 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1725 microversion: 2.1 time: 0.172620 Aug 18 14:29:12.871556 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 269/544] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:12 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:29:12.887515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2ea4f280-c0f7-46b9-9d73-1883b662af41 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:12.888154 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2ea4f280-c0f7-46b9-9d73-1883b662af41 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:12.895015 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ea4f280-c0f7-46b9-9d73-1883b662af41 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:12.895529 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ea4f280-c0f7-46b9-9d73-1883b662af41 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:12.895968 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ea4f280-c0f7-46b9-9d73-1883b662af41 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:12.896690 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ea4f280-c0f7-46b9-9d73-1883b662af41 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:12.897144 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ea4f280-c0f7-46b9-9d73-1883b662af41 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:12.897571 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ea4f280-c0f7-46b9-9d73-1883b662af41 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:12.960330 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-92c1e669-78ab-4305-b483-f23d4d3ffe0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:12.979446 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-92c1e669-78ab-4305-b483-f23d4d3ffe0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:12.982062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-92c1e669-78ab-4305-b483-f23d4d3ffe0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:12.984078 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-92c1e669-78ab-4305-b483-f23d4d3ffe0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1807 microversion: 2.20 time: 0.190170 Aug 18 14:29:12.984761 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 276/545] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:12 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:29:13.013152 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2ea4f280-c0f7-46b9-9d73-1883b662af41 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129382 Aug 18 14:29:13.013742 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 270/546] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Aug 18 14:29:12 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:29:13.716948 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-937f60d8-863f-41c5-8f04-dd3f47e67610 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:13.717885 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-937f60d8-863f-41c5-8f04-dd3f47e67610 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:13.725330 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-937f60d8-863f-41c5-8f04-dd3f47e67610 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:13.726185 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-937f60d8-863f-41c5-8f04-dd3f47e67610 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:13.726651 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-937f60d8-863f-41c5-8f04-dd3f47e67610 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:13.727346 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-937f60d8-863f-41c5-8f04-dd3f47e67610 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:13.728391 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-937f60d8-863f-41c5-8f04-dd3f47e67610 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:13.728521 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-937f60d8-863f-41c5-8f04-dd3f47e67610 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:13.964763 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-691e9a35-a209-4078-8753-b118e615ff46 req-5aca1456-2133-4eec-ae09-3cf70e178fdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e4b5fa-03a1-40fd-b4e4-89152f368dc9", "tag": "6d2988cf-cd5b-4622-b500-36ce6cdb77ca"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:29:13.980044 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-691e9a35-a209-4078-8753-b118e615ff46 req-5aca1456-2133-4eec-ae09-3cf70e178fdd service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:13.980525 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-691e9a35-a209-4078-8753-b118e615ff46 req-5aca1456-2133-4eec-ae09-3cf70e178fdd service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:13.981271 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-691e9a35-a209-4078-8753-b118e615ff46 req-5aca1456-2133-4eec-ae09-3cf70e178fdd service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:13.994260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-691e9a35-a209-4078-8753-b118e615ff46 req-5aca1456-2133-4eec-ae09-3cf70e178fdd service nova] Creating event network-changed:6d2988cf-cd5b-4622-b500-36ce6cdb77ca for instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 on hv-cinder-85220 Aug 18 14:29:14.000053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-691e9a35-a209-4078-8753-b118e615ff46 req-5aca1456-2133-4eec-ae09-3cf70e178fdd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041044 Aug 18 14:29:14.002179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 271/547] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:29:14.009009 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9fb76469-c784-4754-b844-9b55d27f6d3f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:14.009744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9fb76469-c784-4754-b844-9b55d27f6d3f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:14.018074 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fb76469-c784-4754-b844-9b55d27f6d3f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:14.018860 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fb76469-c784-4754-b844-9b55d27f6d3f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:14.019993 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fb76469-c784-4754-b844-9b55d27f6d3f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:14.020877 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fb76469-c784-4754-b844-9b55d27f6d3f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:14.021487 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fb76469-c784-4754-b844-9b55d27f6d3f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:14.022213 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fb76469-c784-4754-b844-9b55d27f6d3f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:14.166677 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9fb76469-c784-4754-b844-9b55d27f6d3f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:14.177599 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9fb76469-c784-4754-b844-9b55d27f6d3f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:14.179241 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9fb76469-c784-4754-b844-9b55d27f6d3f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:14.180453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9fb76469-c784-4754-b844-9b55d27f6d3f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1794 microversion: 2.20 time: 0.176603 Aug 18 14:29:14.186526 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 272/548] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:14 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1794 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:29:14.329466 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-937f60d8-863f-41c5-8f04-dd3f47e67610 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:14.343582 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-937f60d8-863f-41c5-8f04-dd3f47e67610 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1365 microversion: 2.1 time: 0.630664 Aug 18 14:29:14.344158 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 277/549] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:13 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1365 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:15.364952 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c133d6f8-8138-4028-857f-b7745883c749 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:15.365561 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c133d6f8-8138-4028-857f-b7745883c749 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:15.367546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:29:15.368195 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=10 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:29:15.369753 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:29:15.376028 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c133d6f8-8138-4028-857f-b7745883c749 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:15.377076 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c133d6f8-8138-4028-857f-b7745883c749 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:15.377510 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c133d6f8-8138-4028-857f-b7745883c749 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:15.378189 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c133d6f8-8138-4028-857f-b7745883c749 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:15.378637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c133d6f8-8138-4028-857f-b7745883c749 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:15.379054 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c133d6f8-8138-4028-857f-b7745883c749 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:15.511483 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c133d6f8-8138-4028-857f-b7745883c749 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:15.519877 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c133d6f8-8138-4028-857f-b7745883c749 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1365 microversion: 2.1 time: 0.159122 Aug 18 14:29:15.520448 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 273/550] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:15 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:16.016843 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-592acaf7-6f9a-49d8-a338-d20faa1490e2 req-31319d9f-5e2c-44be-bf85-8bea23b1d7c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62e4b5fa-03a1-40fd-b4e4-89152f368dc9", "tag": "6d2988cf-cd5b-4622-b500-36ce6cdb77ca"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:29:16.022070 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:29:16.028113 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-592acaf7-6f9a-49d8-a338-d20faa1490e2 req-31319d9f-5e2c-44be-bf85-8bea23b1d7c5 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:16.028587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-592acaf7-6f9a-49d8-a338-d20faa1490e2 req-31319d9f-5e2c-44be-bf85-8bea23b1d7c5 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:16.029016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-592acaf7-6f9a-49d8-a338-d20faa1490e2 req-31319d9f-5e2c-44be-bf85-8bea23b1d7c5 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:16.041724 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-592acaf7-6f9a-49d8-a338-d20faa1490e2 req-31319d9f-5e2c-44be-bf85-8bea23b1d7c5 service nova] Creating event network-changed:6d2988cf-cd5b-4622-b500-36ce6cdb77ca for instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 on hv-cinder-85220 Aug 18 14:29:16.046475 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-592acaf7-6f9a-49d8-a338-d20faa1490e2 req-31319d9f-5e2c-44be-bf85-8bea23b1d7c5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033294 Aug 18 14:29:16.047042 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 278/551] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:29:16.541115 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0cd39054-71cb-42a2-8974-ec3a370b87bb tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:16.541724 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0cd39054-71cb-42a2-8974-ec3a370b87bb tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:16.548779 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cd39054-71cb-42a2-8974-ec3a370b87bb tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:16.549322 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cd39054-71cb-42a2-8974-ec3a370b87bb tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:16.549840 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cd39054-71cb-42a2-8974-ec3a370b87bb tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:16.550528 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cd39054-71cb-42a2-8974-ec3a370b87bb tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:16.550973 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cd39054-71cb-42a2-8974-ec3a370b87bb tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:16.551412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cd39054-71cb-42a2-8974-ec3a370b87bb tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:16.690616 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0cd39054-71cb-42a2-8974-ec3a370b87bb tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:16.698289 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0cd39054-71cb-42a2-8974-ec3a370b87bb tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1365 microversion: 2.1 time: 0.160983 Aug 18 14:29:16.698860 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 274/552] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:16 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:17.721968 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f18290f1-d4bf-4aa1-9f34-f7d9473a6c44 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:17.722656 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f18290f1-d4bf-4aa1-9f34-f7d9473a6c44 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:17.729343 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f18290f1-d4bf-4aa1-9f34-f7d9473a6c44 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:17.729823 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f18290f1-d4bf-4aa1-9f34-f7d9473a6c44 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:17.730363 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f18290f1-d4bf-4aa1-9f34-f7d9473a6c44 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:17.731126 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f18290f1-d4bf-4aa1-9f34-f7d9473a6c44 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:17.731605 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f18290f1-d4bf-4aa1-9f34-f7d9473a6c44 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:17.732021 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f18290f1-d4bf-4aa1-9f34-f7d9473a6c44 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:17.869957 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f18290f1-d4bf-4aa1-9f34-f7d9473a6c44 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:17.877428 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f18290f1-d4bf-4aa1-9f34-f7d9473a6c44 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1365 microversion: 2.1 time: 0.160864 Aug 18 14:29:17.877989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 279/553] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:17 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:18.898085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-53acabc6-37cc-418c-b993-d2bedca18f57 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:18.898732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-53acabc6-37cc-418c-b993-d2bedca18f57 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:18.905280 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53acabc6-37cc-418c-b993-d2bedca18f57 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:18.905760 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53acabc6-37cc-418c-b993-d2bedca18f57 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:18.906223 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53acabc6-37cc-418c-b993-d2bedca18f57 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:18.906910 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53acabc6-37cc-418c-b993-d2bedca18f57 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:18.907385 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53acabc6-37cc-418c-b993-d2bedca18f57 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:18.907831 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53acabc6-37cc-418c-b993-d2bedca18f57 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:19.052704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-53acabc6-37cc-418c-b993-d2bedca18f57 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:19.060439 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-53acabc6-37cc-418c-b993-d2bedca18f57 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1365 microversion: 2.1 time: 0.166174 Aug 18 14:29:19.061004 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 275/554] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:18 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:19.416433 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-addd41eb-3885-4a57-8e57-458a1f966d1b req-3b1ece55-f80f-4586-a180-2014eaf89b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee35547b-560b-4510-a182-aae686f38082", "name": "network-vif-plugged", "status": "completed", "tag": "436f8533-78b5-46d1-b635-ee6a7c8d2cbc"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:29:19.429613 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-addd41eb-3885-4a57-8e57-458a1f966d1b req-3b1ece55-f80f-4586-a180-2014eaf89b53 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:19.430094 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-addd41eb-3885-4a57-8e57-458a1f966d1b req-3b1ece55-f80f-4586-a180-2014eaf89b53 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:19.430522 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-addd41eb-3885-4a57-8e57-458a1f966d1b req-3b1ece55-f80f-4586-a180-2014eaf89b53 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:19.441393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-addd41eb-3885-4a57-8e57-458a1f966d1b req-3b1ece55-f80f-4586-a180-2014eaf89b53 service nova] Creating event network-vif-plugged:436f8533-78b5-46d1-b635-ee6a7c8d2cbc for instance ee35547b-560b-4510-a182-aae686f38082 on hv-cinder-85220 Aug 18 14:29:19.447520 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-addd41eb-3885-4a57-8e57-458a1f966d1b req-3b1ece55-f80f-4586-a180-2014eaf89b53 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034865 Aug 18 14:29:19.448092 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 280/555] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:29:20.080316 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bfd4d5bf-68fa-4c86-b6c5-1753c937e15f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:20.081033 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bfd4d5bf-68fa-4c86-b6c5-1753c937e15f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:20.087353 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfd4d5bf-68fa-4c86-b6c5-1753c937e15f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:20.087866 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfd4d5bf-68fa-4c86-b6c5-1753c937e15f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:20.088305 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfd4d5bf-68fa-4c86-b6c5-1753c937e15f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:20.089002 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfd4d5bf-68fa-4c86-b6c5-1753c937e15f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:20.089462 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfd4d5bf-68fa-4c86-b6c5-1753c937e15f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:20.089881 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfd4d5bf-68fa-4c86-b6c5-1753c937e15f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:20.234949 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bfd4d5bf-68fa-4c86-b6c5-1753c937e15f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:20.243769 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bfd4d5bf-68fa-4c86-b6c5-1753c937e15f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1365 microversion: 2.1 time: 0.167768 Aug 18 14:29:20.244330 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 276/556] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:20 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:21.265408 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9b1c2d43-5f50-4c38-ba17-484930c7dde0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:21.266138 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9b1c2d43-5f50-4c38-ba17-484930c7dde0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:21.273065 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b1c2d43-5f50-4c38-ba17-484930c7dde0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:21.273530 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b1c2d43-5f50-4c38-ba17-484930c7dde0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:21.273963 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b1c2d43-5f50-4c38-ba17-484930c7dde0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:21.274650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b1c2d43-5f50-4c38-ba17-484930c7dde0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:21.275101 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b1c2d43-5f50-4c38-ba17-484930c7dde0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:21.275556 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b1c2d43-5f50-4c38-ba17-484930c7dde0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:21.403863 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9b1c2d43-5f50-4c38-ba17-484930c7dde0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:21.412263 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9b1c2d43-5f50-4c38-ba17-484930c7dde0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1365 microversion: 2.1 time: 0.151020 Aug 18 14:29:21.412832 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 281/557] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:21 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:22.433601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-094683a7-ccb4-46e2-87fc-abc7f108a7af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:22.434266 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-094683a7-ccb4-46e2-87fc-abc7f108a7af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:22.440796 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-094683a7-ccb4-46e2-87fc-abc7f108a7af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:22.441273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-094683a7-ccb4-46e2-87fc-abc7f108a7af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:22.441701 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-094683a7-ccb4-46e2-87fc-abc7f108a7af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:22.442382 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-094683a7-ccb4-46e2-87fc-abc7f108a7af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:22.442828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-094683a7-ccb4-46e2-87fc-abc7f108a7af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:22.443247 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-094683a7-ccb4-46e2-87fc-abc7f108a7af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:22.571677 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-094683a7-ccb4-46e2-87fc-abc7f108a7af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:22.579767 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-094683a7-ccb4-46e2-87fc-abc7f108a7af tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1365 microversion: 2.1 time: 0.149716 Aug 18 14:29:22.580350 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 277/558] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:22 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:23.601005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f9703d44-6768-4cfd-b3bf-96edadb50844 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:23.601617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f9703d44-6768-4cfd-b3bf-96edadb50844 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:23.608128 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9703d44-6768-4cfd-b3bf-96edadb50844 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:23.608608 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9703d44-6768-4cfd-b3bf-96edadb50844 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:23.609042 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9703d44-6768-4cfd-b3bf-96edadb50844 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:23.609727 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9703d44-6768-4cfd-b3bf-96edadb50844 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:23.610180 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9703d44-6768-4cfd-b3bf-96edadb50844 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:23.611353 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9703d44-6768-4cfd-b3bf-96edadb50844 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:23.742586 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f9703d44-6768-4cfd-b3bf-96edadb50844 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:23.750488 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f9703d44-6768-4cfd-b3bf-96edadb50844 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1365 microversion: 2.1 time: 0.153264 Aug 18 14:29:23.751058 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 282/559] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:23 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:24.771305 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d482641b-9e35-44b0-9946-7d659ad49d41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:24.771929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d482641b-9e35-44b0-9946-7d659ad49d41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:24.778614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d482641b-9e35-44b0-9946-7d659ad49d41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:24.779095 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d482641b-9e35-44b0-9946-7d659ad49d41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:24.779571 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d482641b-9e35-44b0-9946-7d659ad49d41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:24.780483 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d482641b-9e35-44b0-9946-7d659ad49d41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:24.780940 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d482641b-9e35-44b0-9946-7d659ad49d41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:24.781366 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d482641b-9e35-44b0-9946-7d659ad49d41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:24.913040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d482641b-9e35-44b0-9946-7d659ad49d41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:24.921029 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d482641b-9e35-44b0-9946-7d659ad49d41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1554 microversion: 2.1 time: 0.153791 Aug 18 14:29:24.921594 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 278/560] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:24 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:24.942429 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cbb13d46-47b2-4c04-a326-fc9f9aed2262 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:24.942949 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cbb13d46-47b2-4c04-a326-fc9f9aed2262 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:24.948770 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbb13d46-47b2-4c04-a326-fc9f9aed2262 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:24.949245 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbb13d46-47b2-4c04-a326-fc9f9aed2262 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:24.949675 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbb13d46-47b2-4c04-a326-fc9f9aed2262 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:24.950354 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbb13d46-47b2-4c04-a326-fc9f9aed2262 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:24.950803 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbb13d46-47b2-4c04-a326-fc9f9aed2262 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:24.951221 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbb13d46-47b2-4c04-a326-fc9f9aed2262 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:25.028561 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cbb13d46-47b2-4c04-a326-fc9f9aed2262 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090802 Aug 18 14:29:25.029149 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 283/561] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Aug 18 14:29:24 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:29:25.942523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-4223c3cd-08f5-4bf1-84ae-3ef40188701f req-ca2858bb-4a13-49f4-90ae-a69a8a43f957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee35547b-560b-4510-a182-aae686f38082", "tag": "436f8533-78b5-46d1-b635-ee6a7c8d2cbc"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:29:25.952889 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-4223c3cd-08f5-4bf1-84ae-3ef40188701f req-ca2858bb-4a13-49f4-90ae-a69a8a43f957 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:25.953374 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-4223c3cd-08f5-4bf1-84ae-3ef40188701f req-ca2858bb-4a13-49f4-90ae-a69a8a43f957 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:25.953803 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-4223c3cd-08f5-4bf1-84ae-3ef40188701f req-ca2858bb-4a13-49f4-90ae-a69a8a43f957 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:25.966177 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-4223c3cd-08f5-4bf1-84ae-3ef40188701f req-ca2858bb-4a13-49f4-90ae-a69a8a43f957 service nova] Creating event network-changed:436f8533-78b5-46d1-b635-ee6a7c8d2cbc for instance ee35547b-560b-4510-a182-aae686f38082 on hv-cinder-85220 Aug 18 14:29:25.971651 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-4223c3cd-08f5-4bf1-84ae-3ef40188701f req-ca2858bb-4a13-49f4-90ae-a69a8a43f957 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033361 Aug 18 14:29:25.972266 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 279/562] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:29:31.921421 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-36d8d118-4bac-43ae-9111-06870284edb2 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:31.921929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-36d8d118-4bac-43ae-9111-06870284edb2 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:31.924894 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:29:31.930054 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36d8d118-4bac-43ae-9111-06870284edb2 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:31.930526 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36d8d118-4bac-43ae-9111-06870284edb2 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:31.930956 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36d8d118-4bac-43ae-9111-06870284edb2 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:31.931676 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36d8d118-4bac-43ae-9111-06870284edb2 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:31.932125 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36d8d118-4bac-43ae-9111-06870284edb2 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:31.932543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36d8d118-4bac-43ae-9111-06870284edb2 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:32.012635 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-36d8d118-4bac-43ae-9111-06870284edb2 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lazy-loading 'services' on Instance uuid c5e046c2-e6e7-4813-beae-dc4741a95675 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:29:32.086186 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-36d8d118-4bac-43ae-9111-06870284edb2 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675/os-volume_attachments/db61e0cc-2798-4298-84db-167fa0c4e8dc" status: 202 len: 0 microversion: 2.1 time: 0.169063 Aug 18 14:29:32.086796 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 284/563] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Aug 18 14:29:31 2022] DELETE /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675/os-volume_attachments/db61e0cc-2798-4298-84db-167fa0c4e8dc => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:29:33.208668 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-113a53ef-390f-4458-83b8-18c593a080dd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:33.209248 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-113a53ef-390f-4458-83b8-18c593a080dd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:33.215357 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-113a53ef-390f-4458-83b8-18c593a080dd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:33.215861 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-113a53ef-390f-4458-83b8-18c593a080dd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:33.216295 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-113a53ef-390f-4458-83b8-18c593a080dd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:33.216973 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-113a53ef-390f-4458-83b8-18c593a080dd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:33.217685 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-113a53ef-390f-4458-83b8-18c593a080dd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:33.218102 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-113a53ef-390f-4458-83b8-18c593a080dd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:33.244634 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-113a53ef-390f-4458-83b8-18c593a080dd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:29:33.318835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-113a53ef-390f-4458-83b8-18c593a080dd tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 204 len: 0 microversion: 2.1 time: 0.114703 Aug 18 14:29:33.319445 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 280/564] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:29:33 2022] DELETE /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:29:33.329901 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3a2d64ca-6cb5-4de7-b588-db84ef7ec462 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:33.330694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3a2d64ca-6cb5-4de7-b588-db84ef7ec462 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:33.337234 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a2d64ca-6cb5-4de7-b588-db84ef7ec462 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:33.337723 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a2d64ca-6cb5-4de7-b588-db84ef7ec462 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:33.338283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a2d64ca-6cb5-4de7-b588-db84ef7ec462 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:33.338984 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a2d64ca-6cb5-4de7-b588-db84ef7ec462 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:33.339467 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a2d64ca-6cb5-4de7-b588-db84ef7ec462 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:33.339892 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a2d64ca-6cb5-4de7-b588-db84ef7ec462 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:33.477994 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3a2d64ca-6cb5-4de7-b588-db84ef7ec462 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:33.486651 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3a2d64ca-6cb5-4de7-b588-db84ef7ec462 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1513 microversion: 2.1 time: 0.162471 Aug 18 14:29:33.487214 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 285/565] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:33 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:34.509934 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bfacfea0-e989-4cd6-b5f5-1ad648717b98 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:34.510656 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bfacfea0-e989-4cd6-b5f5-1ad648717b98 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:34.517086 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfacfea0-e989-4cd6-b5f5-1ad648717b98 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:34.517559 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfacfea0-e989-4cd6-b5f5-1ad648717b98 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:34.517987 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfacfea0-e989-4cd6-b5f5-1ad648717b98 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:34.518664 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfacfea0-e989-4cd6-b5f5-1ad648717b98 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:34.519110 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfacfea0-e989-4cd6-b5f5-1ad648717b98 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:34.519572 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfacfea0-e989-4cd6-b5f5-1ad648717b98 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:34.522161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:29:34.649909 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bfacfea0-e989-4cd6-b5f5-1ad648717b98 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:34.657620 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bfacfea0-e989-4cd6-b5f5-1ad648717b98 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1513 microversion: 2.1 time: 0.152502 Aug 18 14:29:34.658176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 281/566] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:34 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:35.618318 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-9b78b532-4e9a-4284-8991-7a8cdddbeb9d req-526df4ec-1957-4f7c-83c0-4514002a0c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e046c2-e6e7-4813-beae-dc4741a95675", "name": "network-vif-deleted", "tag": "4730a8e9-144a-4cdc-8c06-f7e344938e02"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:29:35.630576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-9b78b532-4e9a-4284-8991-7a8cdddbeb9d req-526df4ec-1957-4f7c-83c0-4514002a0c68 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:35.631054 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-9b78b532-4e9a-4284-8991-7a8cdddbeb9d req-526df4ec-1957-4f7c-83c0-4514002a0c68 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:35.631504 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-9b78b532-4e9a-4284-8991-7a8cdddbeb9d req-526df4ec-1957-4f7c-83c0-4514002a0c68 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:35.644404 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-9b78b532-4e9a-4284-8991-7a8cdddbeb9d req-526df4ec-1957-4f7c-83c0-4514002a0c68 service nova] Creating event network-vif-deleted:4730a8e9-144a-4cdc-8c06-f7e344938e02 for instance c5e046c2-e6e7-4813-beae-dc4741a95675 on hv-cinder-85220 Aug 18 14:29:35.649283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-9b78b532-4e9a-4284-8991-7a8cdddbeb9d req-526df4ec-1957-4f7c-83c0-4514002a0c68 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034742 Aug 18 14:29:35.649828 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 286/567] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:29:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:29:35.678080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:35.678724 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:35.685292 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:35.685770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:35.686200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:35.686893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:35.687324 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:35.688878 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:35.723549 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:35.724055 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:35.724496 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:35.724946 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lazy-loading 'fault' on Instance uuid c5e046c2-e6e7-4813-beae-dc4741a95675 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:29:35.765638 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '677239d934c04e50b024a001c0152e57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1de27922464f9291f0999378307c06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:35.774125 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c58f0d0b-bac1-4f3a-bdac-33b66403eb5d tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 200 len: 1308 microversion: 2.1 time: 0.099877 Aug 18 14:29:35.774694 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 282/568] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:35 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:36.795784 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c5ff9590-3281-4c1f-a069-65e1e45eefe1 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:36.796485 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c5ff9590-3281-4c1f-a069-65e1e45eefe1 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] [instance: c5e046c2-e6e7-4813-beae-dc4741a95675] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:36.802718 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5ff9590-3281-4c1f-a069-65e1e45eefe1 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:36.803199 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5ff9590-3281-4c1f-a069-65e1e45eefe1 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:36.803670 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5ff9590-3281-4c1f-a069-65e1e45eefe1 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:36.804354 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5ff9590-3281-4c1f-a069-65e1e45eefe1 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:36.804809 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5ff9590-3281-4c1f-a069-65e1e45eefe1 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:36.805236 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5ff9590-3281-4c1f-a069-65e1e45eefe1 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:36.818075 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-c5ff9590-3281-4c1f-a069-65e1e45eefe1 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] HTTP exception thrown: Instance c5e046c2-e6e7-4813-beae-dc4741a95675 could not be found. Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c5ff9590-3281-4c1f-a069-65e1e45eefe1 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Request method failure captured: Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 HTTP/1.1 Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kxMGzs2kWBWugVB_XPrDja8XKldPKfCaxjBLiF8AzdbFon9EhlUGerI0-zlfx1cIllipRTaveKfKIiQPWaZYCt5iTW8qLGaoO1qqC_jcibeYJ9fX2u6R_95aZHGPQJP0biIGbWgllBuf4HCIr38AJuNwNmzq2My0RUOmv29JDzwiA4 Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 4d1de27922464f9291f0999378307c06 Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1191740297 Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:29:36.819694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:29:36.821393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4d1de27922464f9291f0999378307c06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4d1de27922464f9291f0999378307c06"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4d1de27922464f9291f0999378307c06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4d1de27922464f9291f0999378307c06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:29:36.821393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesSnapshotTestJSON-1191740297 Aug 18 14:29:36.821393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 4d1de27922464f9291f0999378307c06 Aug 18 14:29:36.821393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1191740297 Aug 18 14:29:36.821393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesSnapshotTestJSON-1191740297-project Aug 18 14:29:36.821393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:29:36.821393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:29:36.821393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 677239d934c04e50b024a001c0152e57 Aug 18 14:29:36.821393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesSnapshotTestJSON-1191740297-project Aug 18 14:29:36.821393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:29:36.821393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance c5e046c2-e6e7-4813-beae-dc4741a95675 could not be found. Aug 18 14:29:36.821393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': 'c5e046c2-e6e7-4813-beae-dc4741a95675'} Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e046c2-e6e7-4813-beae-dc4741a95675 could not be found. Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:29:36.822474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e046c2-e6e7-4813-beae-dc4741a95675 could not be found. Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e046c2-e6e7-4813-beae-dc4741a95675 could not be found. Aug 18 14:29:36.824066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:29:36.825467 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c5ff9590-3281-4c1f-a069-65e1e45eefe1 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] Returning 404 to user: Instance c5e046c2-e6e7-4813-beae-dc4741a95675 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:29:36.825467 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c5ff9590-3281-4c1f-a069-65e1e45eefe1 tempest-VolumesSnapshotTestJSON-1191740297 tempest-VolumesSnapshotTestJSON-1191740297-project] 10.222.0.39 "GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675" status: 404 len: 111 microversion: 2.1 time: 0.029969 Aug 18 14:29:36.825467 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 287/569] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:29:36 2022] GET /compute/v2.1/servers/c5e046c2-e6e7-4813-beae-dc4741a95675 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:29:55.603054 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eff19f3b-2ec7-48fb-967c-b5eedff31154 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:55.603609 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eff19f3b-2ec7-48fb-967c-b5eedff31154 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:55.606142 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:29:55.606734 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=13 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:29:55.613201 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff19f3b-2ec7-48fb-967c-b5eedff31154 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:55.613684 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff19f3b-2ec7-48fb-967c-b5eedff31154 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:55.614125 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff19f3b-2ec7-48fb-967c-b5eedff31154 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:55.614815 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff19f3b-2ec7-48fb-967c-b5eedff31154 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:55.615269 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff19f3b-2ec7-48fb-967c-b5eedff31154 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:55.615786 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff19f3b-2ec7-48fb-967c-b5eedff31154 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:55.645276 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eff19f3b-2ec7-48fb-967c-b5eedff31154 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/os-volume_attachments/2dd7c1af-358c-462c-a862-92b3cb4cc3ba" status: 200 len: 194 microversion: 2.20 time: 0.044940 Aug 18 14:29:55.645384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 283/570] 10.222.0.39 () {60 vars in 1454 bytes} [Thu Aug 18 14:29:55 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/os-volume_attachments/2dd7c1af-358c-462c-a862-92b3cb4cc3ba => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:29:55.717552 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d3747647-6164-4947-ae2b-e8e91fd9ebad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:55.718033 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d3747647-6164-4947-ae2b-e8e91fd9ebad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:55.720420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=7 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:29:55.721174 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:29:55.726928 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3747647-6164-4947-ae2b-e8e91fd9ebad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:55.727433 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3747647-6164-4947-ae2b-e8e91fd9ebad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:55.728072 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3747647-6164-4947-ae2b-e8e91fd9ebad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:55.729448 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3747647-6164-4947-ae2b-e8e91fd9ebad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:55.729925 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3747647-6164-4947-ae2b-e8e91fd9ebad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:55.730359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3747647-6164-4947-ae2b-e8e91fd9ebad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:55.912408 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-d3747647-6164-4947-ae2b-e8e91fd9ebad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lazy-loading 'services' on Instance uuid 95d09be0-5622-4167-859a-c81e38fc7218 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:29:55.985232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d3747647-6164-4947-ae2b-e8e91fd9ebad tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "DELETE /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/os-volume_attachments/2dd7c1af-358c-462c-a862-92b3cb4cc3ba" status: 202 len: 0 microversion: 2.20 time: 0.272148 Aug 18 14:29:55.985980 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 288/571] 10.222.0.39 () {60 vars in 1457 bytes} [Thu Aug 18 14:29:55 2022] DELETE /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/os-volume_attachments/2dd7c1af-358c-462c-a862-92b3cb4cc3ba => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:29:55.995890 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9fde5f23-62b0-46c9-b8c3-73312fc89f5f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:55.998076 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9fde5f23-62b0-46c9-b8c3-73312fc89f5f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:56.005682 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fde5f23-62b0-46c9-b8c3-73312fc89f5f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:56.006165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fde5f23-62b0-46c9-b8c3-73312fc89f5f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:56.006603 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fde5f23-62b0-46c9-b8c3-73312fc89f5f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:56.007294 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fde5f23-62b0-46c9-b8c3-73312fc89f5f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:56.007781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fde5f23-62b0-46c9-b8c3-73312fc89f5f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:56.008246 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fde5f23-62b0-46c9-b8c3-73312fc89f5f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:56.039505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9fde5f23-62b0-46c9-b8c3-73312fc89f5f tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047950 Aug 18 14:29:56.040047 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 284/572] 10.222.0.39 () {60 vars in 1343 bytes} [Thu Aug 18 14:29:55 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:29:57.054704 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6e6aab46-31fe-4ca6-af44-870551457d7e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:57.057043 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6e6aab46-31fe-4ca6-af44-870551457d7e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:57.063507 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e6aab46-31fe-4ca6-af44-870551457d7e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:57.064003 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e6aab46-31fe-4ca6-af44-870551457d7e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:57.064449 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e6aab46-31fe-4ca6-af44-870551457d7e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:57.065167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e6aab46-31fe-4ca6-af44-870551457d7e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:57.065730 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e6aab46-31fe-4ca6-af44-870551457d7e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:57.066172 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e6aab46-31fe-4ca6-af44-870551457d7e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:57.096004 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6e6aab46-31fe-4ca6-af44-870551457d7e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047626 Aug 18 14:29:57.096558 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 289/573] 10.222.0.39 () {60 vars in 1343 bytes} [Thu Aug 18 14:29:57 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:29:57.161972 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3598cd50-15ab-496a-8ce8-11a8757c6c0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:57.162574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3598cd50-15ab-496a-8ce8-11a8757c6c0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:57.169100 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3598cd50-15ab-496a-8ce8-11a8757c6c0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:57.169614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3598cd50-15ab-496a-8ce8-11a8757c6c0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:57.170031 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3598cd50-15ab-496a-8ce8-11a8757c6c0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:57.170723 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3598cd50-15ab-496a-8ce8-11a8757c6c0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:57.171175 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3598cd50-15ab-496a-8ce8-11a8757c6c0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:57.171760 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3598cd50-15ab-496a-8ce8-11a8757c6c0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:57.197744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3598cd50-15ab-496a-8ce8-11a8757c6c0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:29:57.274302 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3598cd50-15ab-496a-8ce8-11a8757c6c0e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "DELETE /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 204 len: 0 microversion: 2.20 time: 0.116555 Aug 18 14:29:57.274956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 285/574] 10.222.0.39 () {60 vars in 1280 bytes} [Thu Aug 18 14:29:57 2022] DELETE /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 14:29:57.284012 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5475e240-bd19-46de-949e-7a70bb072f10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:57.284710 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5475e240-bd19-46de-949e-7a70bb072f10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:57.291356 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5475e240-bd19-46de-949e-7a70bb072f10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:57.291873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5475e240-bd19-46de-949e-7a70bb072f10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:57.292306 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5475e240-bd19-46de-949e-7a70bb072f10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:57.292990 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5475e240-bd19-46de-949e-7a70bb072f10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:57.293437 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5475e240-bd19-46de-949e-7a70bb072f10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:57.293850 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5475e240-bd19-46de-949e-7a70bb072f10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:57.426557 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5475e240-bd19-46de-949e-7a70bb072f10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:57.434818 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5475e240-bd19-46de-949e-7a70bb072f10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:57.436361 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5475e240-bd19-46de-949e-7a70bb072f10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:57.437517 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5475e240-bd19-46de-949e-7a70bb072f10 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.157350 Aug 18 14:29:57.438112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 290/575] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:57 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:29:58.461926 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-69471500-a986-4379-8a6a-f2d529f6400e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:58.462610 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-69471500-a986-4379-8a6a-f2d529f6400e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:58.469256 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69471500-a986-4379-8a6a-f2d529f6400e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:58.469731 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69471500-a986-4379-8a6a-f2d529f6400e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:58.470163 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69471500-a986-4379-8a6a-f2d529f6400e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:58.470844 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69471500-a986-4379-8a6a-f2d529f6400e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:58.471290 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69471500-a986-4379-8a6a-f2d529f6400e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:58.471734 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69471500-a986-4379-8a6a-f2d529f6400e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:58.658595 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-69471500-a986-4379-8a6a-f2d529f6400e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:58.666823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-69471500-a986-4379-8a6a-f2d529f6400e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:58.668364 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-69471500-a986-4379-8a6a-f2d529f6400e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:58.669503 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-69471500-a986-4379-8a6a-f2d529f6400e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.212542 Aug 18 14:29:58.670057 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 286/576] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:58 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:29:59.694276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6de6a716-646a-4663-9c4d-826dbfa32965 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:29:59.695479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6de6a716-646a-4663-9c4d-826dbfa32965 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:29:59.701856 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6de6a716-646a-4663-9c4d-826dbfa32965 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:59.702341 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6de6a716-646a-4663-9c4d-826dbfa32965 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:59.702806 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6de6a716-646a-4663-9c4d-826dbfa32965 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:59.703493 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6de6a716-646a-4663-9c4d-826dbfa32965 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:29:59.703968 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6de6a716-646a-4663-9c4d-826dbfa32965 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:29:59.704385 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6de6a716-646a-4663-9c4d-826dbfa32965 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:29:59.986079 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6de6a716-646a-4663-9c4d-826dbfa32965 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:59.995923 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6de6a716-646a-4663-9c4d-826dbfa32965 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:59.997424 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6de6a716-646a-4663-9c4d-826dbfa32965 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:29:59.998685 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6de6a716-646a-4663-9c4d-826dbfa32965 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 200 len: 1722 microversion: 2.20 time: 0.309533 Aug 18 14:30:00.015723 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 291/577] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:29:59 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:00.481805 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-67e4bc5f-af16-4e63-9a78-87d54c02ecd1 req-87bf2943-529c-4612-9fba-47cefe55f660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d09be0-5622-4167-859a-c81e38fc7218", "name": "network-vif-deleted", "tag": "ce6e4f0c-73f1-4b80-9e83-e467ad9ba266"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:00.493480 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-67e4bc5f-af16-4e63-9a78-87d54c02ecd1 req-87bf2943-529c-4612-9fba-47cefe55f660 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:00.494062 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-67e4bc5f-af16-4e63-9a78-87d54c02ecd1 req-87bf2943-529c-4612-9fba-47cefe55f660 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:00.494766 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-67e4bc5f-af16-4e63-9a78-87d54c02ecd1 req-87bf2943-529c-4612-9fba-47cefe55f660 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:00.508718 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-67e4bc5f-af16-4e63-9a78-87d54c02ecd1 req-87bf2943-529c-4612-9fba-47cefe55f660 service nova] Creating event network-vif-deleted:ce6e4f0c-73f1-4b80-9e83-e467ad9ba266 for instance 95d09be0-5622-4167-859a-c81e38fc7218 on hv-cinder-85220 Aug 18 14:30:00.514996 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-67e4bc5f-af16-4e63-9a78-87d54c02ecd1 req-87bf2943-529c-4612-9fba-47cefe55f660 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036937 Aug 18 14:30:00.516537 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 287/578] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:01.025979 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-84205266-7544-448f-a4dd-d99bee37c059 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:01.026609 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-84205266-7544-448f-a4dd-d99bee37c059 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:01.034094 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84205266-7544-448f-a4dd-d99bee37c059 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:01.034588 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84205266-7544-448f-a4dd-d99bee37c059 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:01.035095 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84205266-7544-448f-a4dd-d99bee37c059 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:01.036024 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84205266-7544-448f-a4dd-d99bee37c059 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:01.036482 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84205266-7544-448f-a4dd-d99bee37c059 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:01.036917 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84205266-7544-448f-a4dd-d99bee37c059 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:01.051328 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-84205266-7544-448f-a4dd-d99bee37c059 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] HTTP exception thrown: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-84205266-7544-448f-a4dd-d99bee37c059 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Request method failure captured: Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 HTTP/1.1 Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kwUAIi1Wx1P_DjMBSJZmX7v2mJQ7rKoW_jNqpNVpZHhpqVoWG8AVUC7p67lFAx7hP76UlJyW0_uRF6gZJNpYnGAONNb3bYpdfnBFD6nOBS_HUxllybxwU0keCu9xu8kvzRLcZTI-iOamdcTZly1cFLuI57jJlGqNweUjUQxMfSHWgk Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: e25458a67a8b4394b0ebca1482524608 Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:30:01.053017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:30:01.054714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e25458a67a8b4394b0ebca1482524608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:30:01.054714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:30:01.054714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: e25458a67a8b4394b0ebca1482524608 Aug 18 14:30:01.054714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:30:01.054714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeShelveTestJSON-1050663749-project Aug 18 14:30:01.054714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:30:01.054714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:30:01.054714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 8a3d1fa830b540adbe68ef7cf7f08004 Aug 18 14:30:01.054714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1050663749-project Aug 18 14:30:01.054714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:30:01.054714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:30:01.054714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '95d09be0-5622-4167-859a-c81e38fc7218'} Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:30:01.055746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:30:01.057276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:01.059439 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-84205266-7544-448f-a4dd-d99bee37c059 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Returning 404 to user: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:30:01.060292 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-84205266-7544-448f-a4dd-d99bee37c059 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 404 len: 111 microversion: 2.20 time: 0.039715 Aug 18 14:30:01.060846 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 292/579] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:01 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:30:01.070832 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e5148793-bda1-4dcb-aefc-8c0e657d57e5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '.version_select at 0x7fb6220a50d0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:01.100577 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e5148793-bda1-4dcb-aefc-8c0e657d57e5 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-198222168" status: 204 len: 0 microversion: 2.20 time: 0.034888 Aug 18 14:30:01.101364 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 288/580] 10.222.0.39 () {60 vars in 1259 bytes} [Thu Aug 18 14:30:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-198222168 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 14:30:01.603185 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0bffb511-69d0-4ca9-b9eb-36067c546062 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:01.603887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0bffb511-69d0-4ca9-b9eb-36067c546062 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:01.612090 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bffb511-69d0-4ca9-b9eb-36067c546062 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:01.613885 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bffb511-69d0-4ca9-b9eb-36067c546062 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:01.614564 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bffb511-69d0-4ca9-b9eb-36067c546062 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:01.615813 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bffb511-69d0-4ca9-b9eb-36067c546062 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:01.616492 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bffb511-69d0-4ca9-b9eb-36067c546062 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:01.617139 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bffb511-69d0-4ca9-b9eb-36067c546062 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:01.736760 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-0bffb511-69d0-4ca9-b9eb-36067c546062 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lazy-loading 'services' on Instance uuid 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:30:01.828656 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d408d3e-8843-4f98-baed-37dc603e1a41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Action: 'create', calling method: .version_select at 0x7fb6229aa550>, body: {"keypair": {"name": "tempest-keypair-1164660227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMP0w+U5VR4hTnzxZ839TsxrTESrFob4Pci8ZbF2+df7jiMT9qTZ/WrNHE2LHFX6G0ABWasutLpzeBIT4LraR+BJZ10hwcqWTR/6jULaoSFbiZkmr1PDaCb4WB1dmld14Q=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:01.837342 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0bffb511-69d0-4ca9-b9eb-36067c546062 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "DELETE /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-volume_attachments/cd6f466c-a23c-4dac-8f27-472d6d8f9da1" status: 202 len: 0 microversion: 2.1 time: 0.239017 Aug 18 14:30:01.837935 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 293/581] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Aug 18 14:30:01 2022] DELETE /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-volume_attachments/cd6f466c-a23c-4dac-8f27-472d6d8f9da1 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:30:01.846198 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-7d408d3e-8843-4f98-baed-37dc603e1a41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Getting quotas for project e25458a67a8b4394b0ebca1482524608. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:30:01.848764 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0c8c3472-a6a6-414c-a6f0-7794cfa1fe85 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:01.851065 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-7d408d3e-8843-4f98-baed-37dc603e1a41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Getting quotas for user 8a3d1fa830b540adbe68ef7cf7f08004 and project e25458a67a8b4394b0ebca1482524608. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:30:01.851210 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0c8c3472-a6a6-414c-a6f0-7794cfa1fe85 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:01.860217 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c8c3472-a6a6-414c-a6f0-7794cfa1fe85 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:01.860761 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c8c3472-a6a6-414c-a6f0-7794cfa1fe85 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:01.861258 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c8c3472-a6a6-414c-a6f0-7794cfa1fe85 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:01.862073 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c8c3472-a6a6-414c-a6f0-7794cfa1fe85 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:01.862779 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c8c3472-a6a6-414c-a6f0-7794cfa1fe85 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:01.863603 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c8c3472-a6a6-414c-a6f0-7794cfa1fe85 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:01.877615 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d408d3e-8843-4f98-baed-37dc603e1a41 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053314 Aug 18 14:30:01.879877 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 289/582] 10.222.0.39 () {62 vars in 1200 bytes} [Thu Aug 18 14:30:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 18 14:30:01.911764 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0c8c3472-a6a6-414c-a6f0-7794cfa1fe85 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068333 Aug 18 14:30:01.916872 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 294/583] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:30:01 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:30:02.928326 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-749ff66d-6ba8-4931-9db8-b6e2d583558c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:02.934352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-749ff66d-6ba8-4931-9db8-b6e2d583558c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:02.948019 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-749ff66d-6ba8-4931-9db8-b6e2d583558c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:02.949470 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-749ff66d-6ba8-4931-9db8-b6e2d583558c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:02.950682 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-749ff66d-6ba8-4931-9db8-b6e2d583558c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:02.953122 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-749ff66d-6ba8-4931-9db8-b6e2d583558c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:02.954590 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-749ff66d-6ba8-4931-9db8-b6e2d583558c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:02.955258 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-749ff66d-6ba8-4931-9db8-b6e2d583558c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:03.002831 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-749ff66d-6ba8-4931-9db8-b6e2d583558c tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081531 Aug 18 14:30:03.010701 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 290/584] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:30:02 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:30:03.096827 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-109c6dbd-b4cf-489c-b902-7036e8cb36fa tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:03.099877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-109c6dbd-b4cf-489c-b902-7036e8cb36fa tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:03.107944 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-109c6dbd-b4cf-489c-b902-7036e8cb36fa tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:03.108676 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-109c6dbd-b4cf-489c-b902-7036e8cb36fa tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:03.109304 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-109c6dbd-b4cf-489c-b902-7036e8cb36fa tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:03.110236 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-109c6dbd-b4cf-489c-b902-7036e8cb36fa tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:03.110848 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-109c6dbd-b4cf-489c-b902-7036e8cb36fa tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:03.111463 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-109c6dbd-b4cf-489c-b902-7036e8cb36fa tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:03.142634 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-109c6dbd-b4cf-489c-b902-7036e8cb36fa tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:30:03.275734 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-109c6dbd-b4cf-489c-b902-7036e8cb36fa tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "DELETE /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 204 len: 0 microversion: 2.1 time: 0.182259 Aug 18 14:30:03.276637 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 295/585] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:30:03 2022] DELETE /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:30:03.284192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dfb138b4-485b-4868-a939-31e453d5c734 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:03.284920 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dfb138b4-485b-4868-a939-31e453d5c734 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:03.294510 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfb138b4-485b-4868-a939-31e453d5c734 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:03.295469 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfb138b4-485b-4868-a939-31e453d5c734 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:03.296078 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfb138b4-485b-4868-a939-31e453d5c734 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:03.297029 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfb138b4-485b-4868-a939-31e453d5c734 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:03.297750 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfb138b4-485b-4868-a939-31e453d5c734 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:03.298440 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfb138b4-485b-4868-a939-31e453d5c734 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:03.650699 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dfb138b4-485b-4868-a939-31e453d5c734 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:03.659249 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dfb138b4-485b-4868-a939-31e453d5c734 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1685 microversion: 2.1 time: 0.378785 Aug 18 14:30:03.659890 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 291/586] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:03 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1685 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:03.943109 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1905660929", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "933fe250-3a07-4060-bbca-facb12e90528"}], "security_groups": [{"name": "tempest-securitygroup--670419397"}], "key_name": "tempest-keypair-1164660227", "user_data": "}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:04.096342 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] validate_networks() for [('933fe250-3a07-4060-bbca-facb12e90528', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:30:04.686865 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cb242349-0fc8-4046-bf0d-bd027a910a14 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:04.686865 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cb242349-0fc8-4046-bf0d-bd027a910a14 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:04.701672 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb242349-0fc8-4046-bf0d-bd027a910a14 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:04.702376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb242349-0fc8-4046-bf0d-bd027a910a14 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:04.703266 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb242349-0fc8-4046-bf0d-bd027a910a14 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:04.704228 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb242349-0fc8-4046-bf0d-bd027a910a14 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:04.704962 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb242349-0fc8-4046-bf0d-bd027a910a14 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:04.705595 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb242349-0fc8-4046-bf0d-bd027a910a14 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:04.723704 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:30:04.724259 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:30:04.724833 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:30:04.725338 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:30:04.725846 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:30:04.740620 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:04.743273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:04.744001 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:04.746617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:04.747200 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:04.747780 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:04.791640 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Getting quotas for project e25458a67a8b4394b0ebca1482524608. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:30:04.797534 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Getting quotas for user 8a3d1fa830b540adbe68ef7cf7f08004 and project e25458a67a8b4394b0ebca1482524608. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:30:04.817591 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:30:04.820120 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:30:04.884457 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-198b7c44-4502-45cc-8321-e6e74c7aa483 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.947334 Aug 18 14:30:04.885469 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 296/587] 10.222.0.39 () {62 vars in 1188 bytes} [Thu Aug 18 14:30:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 14:30:04.899526 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6eece5d5-77a0-4fc2-9330-fd411e7d6229 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:04.900598 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6eece5d5-77a0-4fc2-9330-fd411e7d6229 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:04.972889 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6eece5d5-77a0-4fc2-9330-fd411e7d6229 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:04.983100 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6eece5d5-77a0-4fc2-9330-fd411e7d6229 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:04.985678 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6eece5d5-77a0-4fc2-9330-fd411e7d6229 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:04.987233 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6eece5d5-77a0-4fc2-9330-fd411e7d6229 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1282 microversion: 2.20 time: 0.094799 Aug 18 14:30:04.989226 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 297/588] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:04 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1282 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:30:05.072279 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cb242349-0fc8-4046-bf0d-bd027a910a14 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:05.096991 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cb242349-0fc8-4046-bf0d-bd027a910a14 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1685 microversion: 2.1 time: 0.418900 Aug 18 14:30:05.105792 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 292/589] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:04 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1685 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:06.011198 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6f66de93-b583-409e-b557-202c5430c4c0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:06.012075 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6f66de93-b583-409e-b557-202c5430c4c0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:06.021146 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f66de93-b583-409e-b557-202c5430c4c0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:06.021631 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f66de93-b583-409e-b557-202c5430c4c0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:06.022277 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f66de93-b583-409e-b557-202c5430c4c0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:06.022970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f66de93-b583-409e-b557-202c5430c4c0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:06.023475 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f66de93-b583-409e-b557-202c5430c4c0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:06.023908 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f66de93-b583-409e-b557-202c5430c4c0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:06.114174 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6f66de93-b583-409e-b557-202c5430c4c0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:06.124663 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6f66de93-b583-409e-b557-202c5430c4c0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:06.125994 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-168693cd-e23c-4d54-9fbd-f3541477f8e6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:06.126461 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6f66de93-b583-409e-b557-202c5430c4c0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:06.126617 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-168693cd-e23c-4d54-9fbd-f3541477f8e6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:06.127243 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6f66de93-b583-409e-b557-202c5430c4c0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1286 microversion: 2.20 time: 0.120574 Aug 18 14:30:06.127813 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 298/590] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:06 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1286 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:06.134336 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-168693cd-e23c-4d54-9fbd-f3541477f8e6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:06.135017 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-168693cd-e23c-4d54-9fbd-f3541477f8e6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:06.135779 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-168693cd-e23c-4d54-9fbd-f3541477f8e6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:06.136490 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-168693cd-e23c-4d54-9fbd-f3541477f8e6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:06.137114 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-168693cd-e23c-4d54-9fbd-f3541477f8e6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:06.137556 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-168693cd-e23c-4d54-9fbd-f3541477f8e6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:06.392046 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-168693cd-e23c-4d54-9fbd-f3541477f8e6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:06.428808 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-168693cd-e23c-4d54-9fbd-f3541477f8e6 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1685 microversion: 2.1 time: 0.306954 Aug 18 14:30:06.429424 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 293/591] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:06 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1685 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:07.152492 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ac23be49-0d8a-45af-983c-45b3fa2f1d74 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:07.153733 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ac23be49-0d8a-45af-983c-45b3fa2f1d74 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:07.162312 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac23be49-0d8a-45af-983c-45b3fa2f1d74 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:07.163304 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac23be49-0d8a-45af-983c-45b3fa2f1d74 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:07.163972 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac23be49-0d8a-45af-983c-45b3fa2f1d74 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:07.164894 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac23be49-0d8a-45af-983c-45b3fa2f1d74 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:07.165556 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac23be49-0d8a-45af-983c-45b3fa2f1d74 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:07.166189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac23be49-0d8a-45af-983c-45b3fa2f1d74 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:07.294899 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ac23be49-0d8a-45af-983c-45b3fa2f1d74 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:07.308938 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ac23be49-0d8a-45af-983c-45b3fa2f1d74 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:07.311475 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ac23be49-0d8a-45af-983c-45b3fa2f1d74 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:07.312851 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ac23be49-0d8a-45af-983c-45b3fa2f1d74 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1340 microversion: 2.20 time: 0.164179 Aug 18 14:30:07.313704 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 299/592] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:07 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1340 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:07.450463 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cba51568-8873-4f43-b846-3de8169bb534 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:07.451660 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cba51568-8873-4f43-b846-3de8169bb534 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:07.459612 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cba51568-8873-4f43-b846-3de8169bb534 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:07.460128 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cba51568-8873-4f43-b846-3de8169bb534 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:07.460554 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cba51568-8873-4f43-b846-3de8169bb534 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:07.461272 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cba51568-8873-4f43-b846-3de8169bb534 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:07.461730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cba51568-8873-4f43-b846-3de8169bb534 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:07.462158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cba51568-8873-4f43-b846-3de8169bb534 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:07.570514 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cba51568-8873-4f43-b846-3de8169bb534 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:07.580528 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cba51568-8873-4f43-b846-3de8169bb534 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 200 len: 1620 microversion: 2.1 time: 0.134032 Aug 18 14:30:07.581819 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 294/593] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:07 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 1620 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:08.038055 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-332025ba-bfd7-4ccf-8614-05a251050c54 req-770c57ef-447c-4566-af3d-3ca5176862cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62e4b5fa-03a1-40fd-b4e4-89152f368dc9", "name": "network-vif-deleted", "tag": "6d2988cf-cd5b-4622-b500-36ce6cdb77ca"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:08.064878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-332025ba-bfd7-4ccf-8614-05a251050c54 req-770c57ef-447c-4566-af3d-3ca5176862cf service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:08.066309 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-332025ba-bfd7-4ccf-8614-05a251050c54 req-770c57ef-447c-4566-af3d-3ca5176862cf service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:08.067018 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-332025ba-bfd7-4ccf-8614-05a251050c54 req-770c57ef-447c-4566-af3d-3ca5176862cf service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:08.094600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-332025ba-bfd7-4ccf-8614-05a251050c54 req-770c57ef-447c-4566-af3d-3ca5176862cf service nova] Creating event network-vif-deleted:6d2988cf-cd5b-4622-b500-36ce6cdb77ca for instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 on hv-cinder-85220 Aug 18 14:30:08.114099 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-332025ba-bfd7-4ccf-8614-05a251050c54 req-770c57ef-447c-4566-af3d-3ca5176862cf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080397 Aug 18 14:30:08.114721 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 300/594] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:08.340511 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1bb1820b-8108-4baa-a228-5d2a5cfdb23e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:08.341127 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1bb1820b-8108-4baa-a228-5d2a5cfdb23e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:08.357558 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bb1820b-8108-4baa-a228-5d2a5cfdb23e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:08.357988 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bb1820b-8108-4baa-a228-5d2a5cfdb23e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:08.359586 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bb1820b-8108-4baa-a228-5d2a5cfdb23e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:08.360272 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bb1820b-8108-4baa-a228-5d2a5cfdb23e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:08.370124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bb1820b-8108-4baa-a228-5d2a5cfdb23e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:08.372013 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bb1820b-8108-4baa-a228-5d2a5cfdb23e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:08.996986 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1bb1820b-8108-4baa-a228-5d2a5cfdb23e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:09.015520 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1bb1820b-8108-4baa-a228-5d2a5cfdb23e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:09.038598 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1bb1820b-8108-4baa-a228-5d2a5cfdb23e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:09.043569 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1bb1820b-8108-4baa-a228-5d2a5cfdb23e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1407 microversion: 2.20 time: 0.707103 Aug 18 14:30:09.044669 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 295/595] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:08 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1407 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:09.130870 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-629c0ffb-7ea6-4ef4-b509-b04f63882fd1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:09.131892 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-629c0ffb-7ea6-4ef4-b509-b04f63882fd1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 62e4b5fa-03a1-40fd-b4e4-89152f368dc9] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:09.160159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-629c0ffb-7ea6-4ef4-b509-b04f63882fd1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:09.161148 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-629c0ffb-7ea6-4ef4-b509-b04f63882fd1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:09.161793 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-629c0ffb-7ea6-4ef4-b509-b04f63882fd1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:09.166921 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-629c0ffb-7ea6-4ef4-b509-b04f63882fd1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:09.167453 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-629c0ffb-7ea6-4ef4-b509-b04f63882fd1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:09.167903 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-629c0ffb-7ea6-4ef4-b509-b04f63882fd1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:09.211396 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-629c0ffb-7ea6-4ef4-b509-b04f63882fd1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] HTTP exception thrown: Instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 could not be found. Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-629c0ffb-7ea6-4ef4-b509-b04f63882fd1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Request method failure captured: Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 HTTP/1.1 Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvDrlAzVmK2YGq_eda07azj0Q5wXK5WMqshAENCB_sdiRt9OENbPVNax3o1QeEbjwKoARV5nzkWWp3C1qz5fFGCEUdhnGLYo5jhlagdb1rEhpPqpOmG3k-UOWefsZlXkDNPL-7u5L9-Nt41h7CA3ghNp-8pAcB0qSc9vAvc1V_hPkw Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: e39a8bb94bfb417b951e4f66473fa900 Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:30:09.223992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:30:09.227300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:30:09.227300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:30:09.227300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: e39a8bb94bfb417b951e4f66473fa900 Aug 18 14:30:09.227300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:30:09.227300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-ServerRescueNegativeTestJSON-127563257-project Aug 18 14:30:09.227300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:30:09.227300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:30:09.227300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 12e95dabd6f04cd9818a77f27b34d927 Aug 18 14:30:09.227300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-ServerRescueNegativeTestJSON-127563257-project Aug 18 14:30:09.227300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:30:09.227300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 could not be found. Aug 18 14:30:09.227300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '62e4b5fa-03a1-40fd-b4e4-89152f368dc9'} Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 could not be found. Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:30:09.228410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 could not be found. Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 could not be found. Aug 18 14:30:09.230873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:09.235161 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-629c0ffb-7ea6-4ef4-b509-b04f63882fd1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Returning 404 to user: Instance 62e4b5fa-03a1-40fd-b4e4-89152f368dc9 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:30:09.236313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-629c0ffb-7ea6-4ef4-b509-b04f63882fd1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9" status: 404 len: 111 microversion: 2.1 time: 0.637298 Aug 18 14:30:09.239803 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 301/596] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:08 2022] GET /compute/v2.1/servers/62e4b5fa-03a1-40fd-b4e4-89152f368dc9 => generated 111 bytes in 639 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:30:09.247983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cec5a814-fab4-43e2-a5c0-9986ffecf4d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '.version_select at 0x7fb6220dc670>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:09.286742 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cec5a814-fab4-43e2-a5c0-9986ffecf4d5 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-17524173" status: 202 len: 0 microversion: 2.1 time: 0.044193 Aug 18 14:30:09.294566 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 296/597] 10.222.0.39 () {58 vars in 1215 bytes} [Thu Aug 18 14:30:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-17524173 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:30:10.071756 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2f25989f-2ef4-4fe6-9a5b-27d4459c204c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:10.074003 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2f25989f-2ef4-4fe6-9a5b-27d4459c204c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:10.092043 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f25989f-2ef4-4fe6-9a5b-27d4459c204c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:10.093446 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f25989f-2ef4-4fe6-9a5b-27d4459c204c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:10.094099 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f25989f-2ef4-4fe6-9a5b-27d4459c204c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:10.095045 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f25989f-2ef4-4fe6-9a5b-27d4459c204c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:10.096400 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f25989f-2ef4-4fe6-9a5b-27d4459c204c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:10.099768 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f25989f-2ef4-4fe6-9a5b-27d4459c204c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:10.415963 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-d67e366c-6594-4f6a-8528-291fce9f4a33 req-3fa78a83-7128-44f0-bc04-185e3d077bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "910c9fdb-a6d3-4e60-843e-9e65d037ea71", "tag": "7ce6f5b2-32fa-4a9b-b50f-f6c24b537da8"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:10.438648 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d67e366c-6594-4f6a-8528-291fce9f4a33 req-3fa78a83-7128-44f0-bc04-185e3d077bb6 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:10.439744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d67e366c-6594-4f6a-8528-291fce9f4a33 req-3fa78a83-7128-44f0-bc04-185e3d077bb6 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:10.440380 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d67e366c-6594-4f6a-8528-291fce9f4a33 req-3fa78a83-7128-44f0-bc04-185e3d077bb6 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:10.458459 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-d67e366c-6594-4f6a-8528-291fce9f4a33 req-3fa78a83-7128-44f0-bc04-185e3d077bb6 service nova] Creating event network-changed:7ce6f5b2-32fa-4a9b-b50f-f6c24b537da8 for instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 on hv-cinder-85220 Aug 18 14:30:10.468337 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-d67e366c-6594-4f6a-8528-291fce9f4a33 req-3fa78a83-7128-44f0-bc04-185e3d077bb6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059274 Aug 18 14:30:10.470317 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 297/598] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:10.584289 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2f25989f-2ef4-4fe6-9a5b-27d4459c204c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:10.609123 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2f25989f-2ef4-4fe6-9a5b-27d4459c204c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:10.610851 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2f25989f-2ef4-4fe6-9a5b-27d4459c204c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:10.613424 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2f25989f-2ef4-4fe6-9a5b-27d4459c204c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1407 microversion: 2.20 time: 0.548471 Aug 18 14:30:10.614321 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 302/599] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:10 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1407 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:11.638628 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9e436744-f1ef-4513-8225-f70b9e9c9ea0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:11.639742 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9e436744-f1ef-4513-8225-f70b9e9c9ea0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:11.652033 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e436744-f1ef-4513-8225-f70b9e9c9ea0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:11.653741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e436744-f1ef-4513-8225-f70b9e9c9ea0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:11.654369 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e436744-f1ef-4513-8225-f70b9e9c9ea0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:11.655264 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e436744-f1ef-4513-8225-f70b9e9c9ea0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:11.655928 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e436744-f1ef-4513-8225-f70b9e9c9ea0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:11.656537 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e436744-f1ef-4513-8225-f70b9e9c9ea0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:11.861658 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:12.012242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e436744-f1ef-4513-8225-f70b9e9c9ea0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:12.026801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e436744-f1ef-4513-8225-f70b9e9c9ea0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:12.030151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e436744-f1ef-4513-8225-f70b9e9c9ea0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:12.031331 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9e436744-f1ef-4513-8225-f70b9e9c9ea0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1407 microversion: 2.20 time: 0.397609 Aug 18 14:30:12.031907 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 298/600] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:11 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:12.783796 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3cd246bc-9d22-4408-829d-3b2f8c7ee39e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:12.785195 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3cd246bc-9d22-4408-829d-3b2f8c7ee39e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:12.804302 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cd246bc-9d22-4408-829d-3b2f8c7ee39e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:12.805133 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cd246bc-9d22-4408-829d-3b2f8c7ee39e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:12.806033 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cd246bc-9d22-4408-829d-3b2f8c7ee39e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:12.807144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cd246bc-9d22-4408-829d-3b2f8c7ee39e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:12.808067 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cd246bc-9d22-4408-829d-3b2f8c7ee39e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:12.808725 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cd246bc-9d22-4408-829d-3b2f8c7ee39e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:12.872593 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3cd246bc-9d22-4408-829d-3b2f8c7ee39e tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/ips" status: 200 len: 147 microversion: 2.1 time: 0.302983 Aug 18 14:30:12.873893 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 303/601] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Aug 18 14:30:12 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/ips => generated 147 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:13.057779 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-767a0bcf-8471-483d-8776-158e54fa3c9e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:13.058425 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-767a0bcf-8471-483d-8776-158e54fa3c9e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:13.086979 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-767a0bcf-8471-483d-8776-158e54fa3c9e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:13.089741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-767a0bcf-8471-483d-8776-158e54fa3c9e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:13.090567 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-767a0bcf-8471-483d-8776-158e54fa3c9e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:13.093896 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-767a0bcf-8471-483d-8776-158e54fa3c9e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:13.096630 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-767a0bcf-8471-483d-8776-158e54fa3c9e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:13.097637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-767a0bcf-8471-483d-8776-158e54fa3c9e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:13.409283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6135fd81-ea21-414b-a351-00d77954a821 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:13.411951 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6135fd81-ea21-414b-a351-00d77954a821 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:13.437273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6135fd81-ea21-414b-a351-00d77954a821 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:13.444929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6135fd81-ea21-414b-a351-00d77954a821 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:13.447204 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6135fd81-ea21-414b-a351-00d77954a821 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:13.449219 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6135fd81-ea21-414b-a351-00d77954a821 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:13.451956 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6135fd81-ea21-414b-a351-00d77954a821 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:13.455788 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6135fd81-ea21-414b-a351-00d77954a821 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:13.576974 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6135fd81-ea21-414b-a351-00d77954a821 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:30:13.650533 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:13.692075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-767a0bcf-8471-483d-8776-158e54fa3c9e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:13.709159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-767a0bcf-8471-483d-8776-158e54fa3c9e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:13.713687 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-767a0bcf-8471-483d-8776-158e54fa3c9e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:13.719578 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-767a0bcf-8471-483d-8776-158e54fa3c9e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1407 microversion: 2.20 time: 0.664630 Aug 18 14:30:13.720504 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 299/602] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:13 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1407 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:13.807115 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6135fd81-ea21-414b-a351-00d77954a821 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 204 len: 0 microversion: 2.1 time: 0.418741 Aug 18 14:30:13.808188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 304/603] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:30:13 2022] DELETE /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:30:13.823497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cd6d0305-52c5-4980-a639-72f26feb882e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:13.824193 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cd6d0305-52c5-4980-a639-72f26feb882e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:13.850141 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd6d0305-52c5-4980-a639-72f26feb882e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:13.851256 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd6d0305-52c5-4980-a639-72f26feb882e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:13.853982 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd6d0305-52c5-4980-a639-72f26feb882e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:13.856916 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd6d0305-52c5-4980-a639-72f26feb882e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:13.858533 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd6d0305-52c5-4980-a639-72f26feb882e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:13.861277 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd6d0305-52c5-4980-a639-72f26feb882e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:14.128813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cd6d0305-52c5-4980-a639-72f26feb882e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:14.139070 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cd6d0305-52c5-4980-a639-72f26feb882e tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1505 microversion: 2.1 time: 0.326669 Aug 18 14:30:14.140294 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 300/604] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:13 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:14.651464 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d3d27dca-ab9a-4300-9cab-defbbb3f40a4 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05ac1dd3-a553-4fbd-83d6-a57a0ff444b2"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:14.654186 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d3d27dca-ab9a-4300-9cab-defbbb3f40a4 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:14.660566 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3d27dca-ab9a-4300-9cab-defbbb3f40a4 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:14.661282 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3d27dca-ab9a-4300-9cab-defbbb3f40a4 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:14.661882 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3d27dca-ab9a-4300-9cab-defbbb3f40a4 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:14.662756 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3d27dca-ab9a-4300-9cab-defbbb3f40a4 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:14.663213 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3d27dca-ab9a-4300-9cab-defbbb3f40a4 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:14.663668 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3d27dca-ab9a-4300-9cab-defbbb3f40a4 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:14.756897 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c2aaefaf-4cdf-419c-b521-02cf6984dbd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:14.757719 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c2aaefaf-4cdf-419c-b521-02cf6984dbd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:14.768282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2aaefaf-4cdf-419c-b521-02cf6984dbd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:14.770898 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2aaefaf-4cdf-419c-b521-02cf6984dbd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:14.771563 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2aaefaf-4cdf-419c-b521-02cf6984dbd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:14.772424 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2aaefaf-4cdf-419c-b521-02cf6984dbd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:14.773468 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:14.774313 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2aaefaf-4cdf-419c-b521-02cf6984dbd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:14.774817 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2aaefaf-4cdf-419c-b521-02cf6984dbd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:14.923883 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c2aaefaf-4cdf-419c-b521-02cf6984dbd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:14.934553 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c2aaefaf-4cdf-419c-b521-02cf6984dbd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:14.936392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c2aaefaf-4cdf-419c-b521-02cf6984dbd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:14.937710 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c2aaefaf-4cdf-419c-b521-02cf6984dbd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1407 microversion: 2.20 time: 0.195506 Aug 18 14:30:14.939153 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 301/605] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:14 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:14.980480 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=8 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:15.189364 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-45f44a86-f4bc-40f9-b2b6-687563d30112 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:15.191614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-45f44a86-f4bc-40f9-b2b6-687563d30112 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:15.207321 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45f44a86-f4bc-40f9-b2b6-687563d30112 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:15.208091 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45f44a86-f4bc-40f9-b2b6-687563d30112 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:15.229243 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45f44a86-f4bc-40f9-b2b6-687563d30112 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:15.230854 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45f44a86-f4bc-40f9-b2b6-687563d30112 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:15.231581 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45f44a86-f4bc-40f9-b2b6-687563d30112 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:15.232203 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45f44a86-f4bc-40f9-b2b6-687563d30112 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:15.239935 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:15.583144 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-45f44a86-f4bc-40f9-b2b6-687563d30112 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:15.599106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-45f44a86-f4bc-40f9-b2b6-687563d30112 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1505 microversion: 2.1 time: 0.433691 Aug 18 14:30:15.599947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 302/606] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:15 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:30:15.986739 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-270d5dc4-1e96-432d-8618-0df87136a3bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:15.991233 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-270d5dc4-1e96-432d-8618-0df87136a3bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:16.069348 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-270d5dc4-1e96-432d-8618-0df87136a3bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:16.090502 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-270d5dc4-1e96-432d-8618-0df87136a3bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:16.097773 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-270d5dc4-1e96-432d-8618-0df87136a3bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:16.114541 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-270d5dc4-1e96-432d-8618-0df87136a3bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:16.122215 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-270d5dc4-1e96-432d-8618-0df87136a3bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:16.128577 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-270d5dc4-1e96-432d-8618-0df87136a3bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:16.304196 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d3d27dca-ab9a-4300-9cab-defbbb3f40a4 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "POST /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.656070 Aug 18 14:30:16.305842 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 305/607] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:30:14 2022] POST /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/os-volume_attachments => generated 194 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:16.479174 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-270d5dc4-1e96-432d-8618-0df87136a3bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:16.492725 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-270d5dc4-1e96-432d-8618-0df87136a3bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:16.494605 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-270d5dc4-1e96-432d-8618-0df87136a3bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:16.496232 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-270d5dc4-1e96-432d-8618-0df87136a3bb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1407 microversion: 2.20 time: 0.530912 Aug 18 14:30:16.513317 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 303/608] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:15 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1407 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:16.623189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7afc76eb-e689-47fa-9aa5-0167f3354645 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:16.624626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7afc76eb-e689-47fa-9aa5-0167f3354645 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:16.654176 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7afc76eb-e689-47fa-9aa5-0167f3354645 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:16.657018 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7afc76eb-e689-47fa-9aa5-0167f3354645 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:16.658503 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7afc76eb-e689-47fa-9aa5-0167f3354645 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:16.660481 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7afc76eb-e689-47fa-9aa5-0167f3354645 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:16.664296 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7afc76eb-e689-47fa-9aa5-0167f3354645 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:16.667810 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7afc76eb-e689-47fa-9aa5-0167f3354645 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:16.889752 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7afc76eb-e689-47fa-9aa5-0167f3354645 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:16.901149 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7afc76eb-e689-47fa-9aa5-0167f3354645 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 200 len: 1463 microversion: 2.1 time: 0.282079 Aug 18 14:30:16.909799 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 306/609] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:16 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 1463 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:16.985279 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-e5fd1a91-14f2-47de-9aca-690d53ea521f req-83b6f338-890b-460a-89c8-fab3889e1764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5932e419-fd0d-407e-86bf-4855a74ea353", "name": "network-vif-deleted", "tag": "7764691c-d09f-48e5-b6d6-986f0882a254"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:16.998280 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e5fd1a91-14f2-47de-9aca-690d53ea521f req-83b6f338-890b-460a-89c8-fab3889e1764 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:16.999003 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e5fd1a91-14f2-47de-9aca-690d53ea521f req-83b6f338-890b-460a-89c8-fab3889e1764 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:16.999638 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-e5fd1a91-14f2-47de-9aca-690d53ea521f req-83b6f338-890b-460a-89c8-fab3889e1764 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:17.032821 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-e5fd1a91-14f2-47de-9aca-690d53ea521f req-83b6f338-890b-460a-89c8-fab3889e1764 service nova] Creating event network-vif-deleted:7764691c-d09f-48e5-b6d6-986f0882a254 for instance 5932e419-fd0d-407e-86bf-4855a74ea353 on hv-cinder-85220 Aug 18 14:30:17.050419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-e5fd1a91-14f2-47de-9aca-690d53ea521f req-83b6f338-890b-460a-89c8-fab3889e1764 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063855 Aug 18 14:30:17.051748 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 304/610] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:17.521295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f9c29396-fec1-442e-883a-205d28fb5eb3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:17.521894 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f9c29396-fec1-442e-883a-205d28fb5eb3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:17.531071 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9c29396-fec1-442e-883a-205d28fb5eb3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:17.531611 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9c29396-fec1-442e-883a-205d28fb5eb3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:17.532122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9c29396-fec1-442e-883a-205d28fb5eb3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:17.532825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9c29396-fec1-442e-883a-205d28fb5eb3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:17.541176 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9c29396-fec1-442e-883a-205d28fb5eb3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:17.541555 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9c29396-fec1-442e-883a-205d28fb5eb3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:17.742584 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f9c29396-fec1-442e-883a-205d28fb5eb3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:17.753393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f9c29396-fec1-442e-883a-205d28fb5eb3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:17.755823 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f9c29396-fec1-442e-883a-205d28fb5eb3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:17.757797 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f9c29396-fec1-442e-883a-205d28fb5eb3 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1407 microversion: 2.20 time: 0.240041 Aug 18 14:30:17.758840 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 307/611] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:17 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:17.923078 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6ace017c-5fc3-4893-9278-a9e1ae72049d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:17.924466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6ace017c-5fc3-4893-9278-a9e1ae72049d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 5932e419-fd0d-407e-86bf-4855a74ea353] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:17.934450 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ace017c-5fc3-4893-9278-a9e1ae72049d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:17.935499 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ace017c-5fc3-4893-9278-a9e1ae72049d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:17.936131 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ace017c-5fc3-4893-9278-a9e1ae72049d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:17.937027 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ace017c-5fc3-4893-9278-a9e1ae72049d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:17.937634 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ace017c-5fc3-4893-9278-a9e1ae72049d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:17.938219 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ace017c-5fc3-4893-9278-a9e1ae72049d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:17.969451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-6ace017c-5fc3-4893-9278-a9e1ae72049d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] HTTP exception thrown: Instance 5932e419-fd0d-407e-86bf-4855a74ea353 could not be found. Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6ace017c-5fc3-4893-9278-a9e1ae72049d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Request method failure captured: Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 HTTP/1.1 Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvDrlAzVmK2YGq_eda07azj0Q5wXK5WMqshAENCB_sdiRt9OENbPVNax3o1QeEbjwKoARV5nzkWWp3C1qz5fFGCEUdhnGLYo5jhlagdb1rEhpPqpOmG3k-UOWefsZlXkDNPL-7u5L9-Nt41h7CA3ghNp-8pAcB0qSc9vAvc1V_hPkw Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: e39a8bb94bfb417b951e4f66473fa900 Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:30:17.971421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:30:17.973637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:30:17.973637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:30:17.973637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: e39a8bb94bfb417b951e4f66473fa900 Aug 18 14:30:17.973637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:30:17.973637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-ServerRescueNegativeTestJSON-127563257-project Aug 18 14:30:17.973637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:30:17.973637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:30:17.973637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 12e95dabd6f04cd9818a77f27b34d927 Aug 18 14:30:17.973637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-127563257-project Aug 18 14:30:17.973637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:30:17.973637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 5932e419-fd0d-407e-86bf-4855a74ea353 could not be found. Aug 18 14:30:17.973637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '5932e419-fd0d-407e-86bf-4855a74ea353'} Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5932e419-fd0d-407e-86bf-4855a74ea353 could not be found. Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:30:17.974540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5932e419-fd0d-407e-86bf-4855a74ea353 could not be found. Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5932e419-fd0d-407e-86bf-4855a74ea353 could not be found. Aug 18 14:30:17.976124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:17.978428 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6ace017c-5fc3-4893-9278-a9e1ae72049d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Returning 404 to user: Instance 5932e419-fd0d-407e-86bf-4855a74ea353 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:30:17.979286 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6ace017c-5fc3-4893-9278-a9e1ae72049d tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353" status: 404 len: 111 microversion: 2.1 time: 0.060926 Aug 18 14:30:17.982931 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 305/612] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:17 2022] GET /compute/v2.1/servers/5932e419-fd0d-407e-86bf-4855a74ea353 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:30:17.989101 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3450785d-1e98-4890-8e5a-0c8762a0619f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:17.989928 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3450785d-1e98-4890-8e5a-0c8762a0619f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:18.002313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3450785d-1e98-4890-8e5a-0c8762a0619f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:18.003459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3450785d-1e98-4890-8e5a-0c8762a0619f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:18.003899 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3450785d-1e98-4890-8e5a-0c8762a0619f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:18.005002 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3450785d-1e98-4890-8e5a-0c8762a0619f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:18.005626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3450785d-1e98-4890-8e5a-0c8762a0619f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:18.006247 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3450785d-1e98-4890-8e5a-0c8762a0619f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:18.042131 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3450785d-1e98-4890-8e5a-0c8762a0619f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:30:18.149994 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3450785d-1e98-4890-8e5a-0c8762a0619f tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "DELETE /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 204 len: 0 microversion: 2.1 time: 0.165284 Aug 18 14:30:18.150742 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 308/613] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:30:17 2022] DELETE /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:30:18.159044 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-adb01b80-70e8-4877-88f6-d83f408dc8c1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:18.160203 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-adb01b80-70e8-4877-88f6-d83f408dc8c1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:18.167073 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adb01b80-70e8-4877-88f6-d83f408dc8c1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:18.167593 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adb01b80-70e8-4877-88f6-d83f408dc8c1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:18.168035 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adb01b80-70e8-4877-88f6-d83f408dc8c1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:18.168925 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adb01b80-70e8-4877-88f6-d83f408dc8c1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:18.169578 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adb01b80-70e8-4877-88f6-d83f408dc8c1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:18.170013 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adb01b80-70e8-4877-88f6-d83f408dc8c1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:18.347207 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-adb01b80-70e8-4877-88f6-d83f408dc8c1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:18.362961 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-adb01b80-70e8-4877-88f6-d83f408dc8c1 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.207277 Aug 18 14:30:18.364001 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 306/614] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:18 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:18.782986 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-323dbef2-d558-4485-a7a8-4f757836f8b0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:18.783895 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-323dbef2-d558-4485-a7a8-4f757836f8b0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:18.791459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-323dbef2-d558-4485-a7a8-4f757836f8b0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:18.792333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-323dbef2-d558-4485-a7a8-4f757836f8b0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:18.793031 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-323dbef2-d558-4485-a7a8-4f757836f8b0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:18.794064 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-323dbef2-d558-4485-a7a8-4f757836f8b0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:18.794644 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-323dbef2-d558-4485-a7a8-4f757836f8b0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:18.795400 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-323dbef2-d558-4485-a7a8-4f757836f8b0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:18.968777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-323dbef2-d558-4485-a7a8-4f757836f8b0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:18.979707 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-323dbef2-d558-4485-a7a8-4f757836f8b0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:18.981552 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-323dbef2-d558-4485-a7a8-4f757836f8b0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:18.982827 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-323dbef2-d558-4485-a7a8-4f757836f8b0 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1407 microversion: 2.20 time: 0.204383 Aug 18 14:30:18.984123 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 309/615] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:18 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:19.384023 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f8ac2734-9428-4f7f-a783-c9391b764efb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:19.384640 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f8ac2734-9428-4f7f-a783-c9391b764efb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:19.392617 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8ac2734-9428-4f7f-a783-c9391b764efb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:19.393098 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8ac2734-9428-4f7f-a783-c9391b764efb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:19.394265 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8ac2734-9428-4f7f-a783-c9391b764efb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:19.395305 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8ac2734-9428-4f7f-a783-c9391b764efb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:19.395946 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8ac2734-9428-4f7f-a783-c9391b764efb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:19.396532 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8ac2734-9428-4f7f-a783-c9391b764efb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:19.578660 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f8ac2734-9428-4f7f-a783-c9391b764efb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:19.587524 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f8ac2734-9428-4f7f-a783-c9391b764efb tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.207098 Aug 18 14:30:19.588105 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 307/616] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:19 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:19.810127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-9575d135-46af-4a8e-8be1-506870f63663 req-06db91e1-dca5-44cd-a54d-87ae7dfeec15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "910c9fdb-a6d3-4e60-843e-9e65d037ea71", "name": "network-vif-plugged", "status": "completed", "tag": "7ce6f5b2-32fa-4a9b-b50f-f6c24b537da8"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:19.825466 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-9575d135-46af-4a8e-8be1-506870f63663 req-06db91e1-dca5-44cd-a54d-87ae7dfeec15 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:19.825945 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-9575d135-46af-4a8e-8be1-506870f63663 req-06db91e1-dca5-44cd-a54d-87ae7dfeec15 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:19.826371 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-9575d135-46af-4a8e-8be1-506870f63663 req-06db91e1-dca5-44cd-a54d-87ae7dfeec15 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:19.844165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-9575d135-46af-4a8e-8be1-506870f63663 req-06db91e1-dca5-44cd-a54d-87ae7dfeec15 service nova] Creating event network-vif-plugged:7ce6f5b2-32fa-4a9b-b50f-f6c24b537da8 for instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 on hv-cinder-85220 Aug 18 14:30:19.849993 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-9575d135-46af-4a8e-8be1-506870f63663 req-06db91e1-dca5-44cd-a54d-87ae7dfeec15 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043481 Aug 18 14:30:19.851141 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 310/617] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:20.008095 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b76fff13-31cc-4df0-bddf-6590ebf76730 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:20.009099 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b76fff13-31cc-4df0-bddf-6590ebf76730 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:20.015588 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b76fff13-31cc-4df0-bddf-6590ebf76730 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:20.016086 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b76fff13-31cc-4df0-bddf-6590ebf76730 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:20.017231 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b76fff13-31cc-4df0-bddf-6590ebf76730 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:20.018856 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b76fff13-31cc-4df0-bddf-6590ebf76730 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:20.020326 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b76fff13-31cc-4df0-bddf-6590ebf76730 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:20.020854 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b76fff13-31cc-4df0-bddf-6590ebf76730 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:20.169986 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b76fff13-31cc-4df0-bddf-6590ebf76730 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:20.181966 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b76fff13-31cc-4df0-bddf-6590ebf76730 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:20.183778 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b76fff13-31cc-4df0-bddf-6590ebf76730 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:20.185106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b76fff13-31cc-4df0-bddf-6590ebf76730 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1407 microversion: 2.20 time: 0.181047 Aug 18 14:30:20.185878 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 308/618] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:20 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:20.614787 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c4aec4e1-3982-4342-9d1a-06a64e451504 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:20.615617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c4aec4e1-3982-4342-9d1a-06a64e451504 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:20.622026 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4aec4e1-3982-4342-9d1a-06a64e451504 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:20.622518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4aec4e1-3982-4342-9d1a-06a64e451504 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:20.622957 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4aec4e1-3982-4342-9d1a-06a64e451504 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:20.624361 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4aec4e1-3982-4342-9d1a-06a64e451504 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:20.624361 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4aec4e1-3982-4342-9d1a-06a64e451504 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:20.624573 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4aec4e1-3982-4342-9d1a-06a64e451504 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:20.795966 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c4aec4e1-3982-4342-9d1a-06a64e451504 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:20.805024 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c4aec4e1-3982-4342-9d1a-06a64e451504 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1520 microversion: 2.1 time: 0.198842 Aug 18 14:30:20.806348 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 311/619] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:20 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:21.212270 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8f365742-5e5c-4767-957d-2c95daec3c4a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:21.213757 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8f365742-5e5c-4767-957d-2c95daec3c4a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:21.226566 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f365742-5e5c-4767-957d-2c95daec3c4a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:21.231335 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f365742-5e5c-4767-957d-2c95daec3c4a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:21.234376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f365742-5e5c-4767-957d-2c95daec3c4a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:21.237435 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f365742-5e5c-4767-957d-2c95daec3c4a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:21.238209 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f365742-5e5c-4767-957d-2c95daec3c4a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:21.238879 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f365742-5e5c-4767-957d-2c95daec3c4a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:21.419567 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8f365742-5e5c-4767-957d-2c95daec3c4a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:21.429234 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8f365742-5e5c-4767-957d-2c95daec3c4a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:21.430919 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8f365742-5e5c-4767-957d-2c95daec3c4a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:21.432527 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8f365742-5e5c-4767-957d-2c95daec3c4a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1407 microversion: 2.20 time: 0.228618 Aug 18 14:30:21.445007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 309/620] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:21 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:21.721895 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-4f30cdd2-d42e-4628-b872-91dfe21537f4 req-15b3682b-1eee-44bb-bc60-e5a67d252990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "222bc1f0-96b3-4d29-960a-39437b4dc0a5", "name": "network-vif-deleted", "tag": "23ad159c-abaf-411f-bb62-90941b33a93c"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:21.733262 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-4f30cdd2-d42e-4628-b872-91dfe21537f4 req-15b3682b-1eee-44bb-bc60-e5a67d252990 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:21.734063 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-4f30cdd2-d42e-4628-b872-91dfe21537f4 req-15b3682b-1eee-44bb-bc60-e5a67d252990 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:21.734650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-4f30cdd2-d42e-4628-b872-91dfe21537f4 req-15b3682b-1eee-44bb-bc60-e5a67d252990 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:21.746560 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-4f30cdd2-d42e-4628-b872-91dfe21537f4 req-15b3682b-1eee-44bb-bc60-e5a67d252990 service nova] Creating event network-vif-deleted:23ad159c-abaf-411f-bb62-90941b33a93c for instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 on hv-cinder-85220 Aug 18 14:30:21.751587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-4f30cdd2-d42e-4628-b872-91dfe21537f4 req-15b3682b-1eee-44bb-bc60-e5a67d252990 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034089 Aug 18 14:30:21.753938 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 312/621] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:21.829563 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a8205d4-15ab-498a-a1fb-01bfed679f39 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:21.830426 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0a8205d4-15ab-498a-a1fb-01bfed679f39 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:21.837961 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a8205d4-15ab-498a-a1fb-01bfed679f39 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:21.838496 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a8205d4-15ab-498a-a1fb-01bfed679f39 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:21.838944 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a8205d4-15ab-498a-a1fb-01bfed679f39 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:21.839704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a8205d4-15ab-498a-a1fb-01bfed679f39 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:21.840200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a8205d4-15ab-498a-a1fb-01bfed679f39 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:21.840638 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a8205d4-15ab-498a-a1fb-01bfed679f39 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:21.911849 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0a8205d4-15ab-498a-a1fb-01bfed679f39 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:21.920154 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a8205d4-15ab-498a-a1fb-01bfed679f39 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1478 microversion: 2.1 time: 0.094580 Aug 18 14:30:21.921029 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 310/622] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:21 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1478 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:22.459566 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-174ab43a-e656-4276-a4d7-db5dcad0d981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:22.460274 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-174ab43a-e656-4276-a4d7-db5dcad0d981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:22.467387 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-174ab43a-e656-4276-a4d7-db5dcad0d981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:22.467886 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-174ab43a-e656-4276-a4d7-db5dcad0d981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:22.468321 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-174ab43a-e656-4276-a4d7-db5dcad0d981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:22.469141 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-174ab43a-e656-4276-a4d7-db5dcad0d981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:22.469869 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-174ab43a-e656-4276-a4d7-db5dcad0d981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:22.470442 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-174ab43a-e656-4276-a4d7-db5dcad0d981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:22.635569 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-174ab43a-e656-4276-a4d7-db5dcad0d981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:22.644504 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-174ab43a-e656-4276-a4d7-db5dcad0d981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:22.646262 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-174ab43a-e656-4276-a4d7-db5dcad0d981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:22.647063 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-174ab43a-e656-4276-a4d7-db5dcad0d981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1407 microversion: 2.20 time: 0.192596 Aug 18 14:30:22.647901 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 313/623] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:22 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:22.959927 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:22.960786 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:22.972432 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:22.973007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:22.974620 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:22.975455 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:22.978564 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:22.979104 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:23.017630 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:23.018811 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:23.019563 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:23.020565 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lazy-loading 'fault' on Instance uuid 222bc1f0-96b3-4d29-960a-39437b4dc0a5 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:30:23.088176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12e95dabd6f04cd9818a77f27b34d927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e39a8bb94bfb417b951e4f66473fa900', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:23.096494 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0e26c6d9-9d39-4441-87c9-ec275c99b1ef tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 200 len: 1311 microversion: 2.1 time: 0.141186 Aug 18 14:30:23.097070 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 311/624] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:22 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 1311 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:23.670571 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c74a102f-f825-402d-b5cb-da0991771f14 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:23.671181 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c74a102f-f825-402d-b5cb-da0991771f14 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:23.681337 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c74a102f-f825-402d-b5cb-da0991771f14 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:23.682105 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c74a102f-f825-402d-b5cb-da0991771f14 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:23.682756 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c74a102f-f825-402d-b5cb-da0991771f14 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:23.683640 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c74a102f-f825-402d-b5cb-da0991771f14 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:23.684256 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c74a102f-f825-402d-b5cb-da0991771f14 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:23.684689 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c74a102f-f825-402d-b5cb-da0991771f14 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:23.841046 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c74a102f-f825-402d-b5cb-da0991771f14 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:23.851212 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c74a102f-f825-402d-b5cb-da0991771f14 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:23.852759 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c74a102f-f825-402d-b5cb-da0991771f14 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:23.853926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c74a102f-f825-402d-b5cb-da0991771f14 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1599 microversion: 2.20 time: 0.188472 Aug 18 14:30:23.854485 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 314/625] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:30:23 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1599 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:30:23.879702 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b4e827e6-460b-4ed2-af2e-28e4883a7336 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:23.880430 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b4e827e6-460b-4ed2-af2e-28e4883a7336 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:23.886685 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4e827e6-460b-4ed2-af2e-28e4883a7336 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:23.887176 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4e827e6-460b-4ed2-af2e-28e4883a7336 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:23.887660 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4e827e6-460b-4ed2-af2e-28e4883a7336 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:23.888365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4e827e6-460b-4ed2-af2e-28e4883a7336 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:23.888819 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4e827e6-460b-4ed2-af2e-28e4883a7336 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:23.889247 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4e827e6-460b-4ed2-af2e-28e4883a7336 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:23.977034 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b4e827e6-460b-4ed2-af2e-28e4883a7336 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102573 Aug 18 14:30:23.977981 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 312/626] 10.222.0.39 () {60 vars in 1316 bytes} [Thu Aug 18 14:30:23 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:30:24.117320 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2a4c7cef-d0bb-4a7f-9e73-96241555c372 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:24.117942 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2a4c7cef-d0bb-4a7f-9e73-96241555c372 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] [instance: 222bc1f0-96b3-4d29-960a-39437b4dc0a5] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:24.127181 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a4c7cef-d0bb-4a7f-9e73-96241555c372 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:24.128482 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a4c7cef-d0bb-4a7f-9e73-96241555c372 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:24.134819 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a4c7cef-d0bb-4a7f-9e73-96241555c372 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:24.135875 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a4c7cef-d0bb-4a7f-9e73-96241555c372 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:24.136529 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a4c7cef-d0bb-4a7f-9e73-96241555c372 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:24.137138 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a4c7cef-d0bb-4a7f-9e73-96241555c372 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:24.165092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-93d067cf-a4ef-44f7-9553-c7b2ff5f8a15 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05ac1dd3-a553-4fbd-83d6-a57a0ff444b2"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:24.168350 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-93d067cf-a4ef-44f7-9553-c7b2ff5f8a15 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:24.173837 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-2a4c7cef-d0bb-4a7f-9e73-96241555c372 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] HTTP exception thrown: Instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 could not be found. Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2a4c7cef-d0bb-4a7f-9e73-96241555c372 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Request method failure captured: Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 HTTP/1.1 Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvDrlAzVmK2YGq_eda07azj0Q5wXK5WMqshAENCB_sdiRt9OENbPVNax3o1QeEbjwKoARV5nzkWWp3C1qz5fFGCEUdhnGLYo5jhlagdb1rEhpPqpOmG3k-UOWefsZlXkDNPL-7u5L9-Nt41h7CA3ghNp-8pAcB0qSc9vAvc1V_hPkw Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: e39a8bb94bfb417b951e4f66473fa900 Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:30:24.176359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:30:24.177941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e39a8bb94bfb417b951e4f66473fa900"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:30:24.177941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:30:24.177941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: e39a8bb94bfb417b951e4f66473fa900 Aug 18 14:30:24.177941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-127563257 Aug 18 14:30:24.177941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-ServerRescueNegativeTestJSON-127563257-project Aug 18 14:30:24.177941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:30:24.177941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:30:24.177941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 12e95dabd6f04cd9818a77f27b34d927 Aug 18 14:30:24.177941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-ServerRescueNegativeTestJSON-127563257-project Aug 18 14:30:24.177941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:30:24.177941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 could not be found. Aug 18 14:30:24.177941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '222bc1f0-96b3-4d29-960a-39437b4dc0a5'} Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 could not be found. Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:30:24.178802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 could not be found. Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 could not be found. Aug 18 14:30:24.180255 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:30:24.181541 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93d067cf-a4ef-44f7-9553-c7b2ff5f8a15 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:24.181645 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93d067cf-a4ef-44f7-9553-c7b2ff5f8a15 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:24.182004 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93d067cf-a4ef-44f7-9553-c7b2ff5f8a15 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:24.182383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2a4c7cef-d0bb-4a7f-9e73-96241555c372 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] Returning 404 to user: Instance 222bc1f0-96b3-4d29-960a-39437b4dc0a5 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:30:24.182707 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93d067cf-a4ef-44f7-9553-c7b2ff5f8a15 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:24.183160 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93d067cf-a4ef-44f7-9553-c7b2ff5f8a15 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:24.183290 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2a4c7cef-d0bb-4a7f-9e73-96241555c372 tempest-ServerRescueNegativeTestJSON-127563257 tempest-ServerRescueNegativeTestJSON-127563257-project] 10.222.0.39 "GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5" status: 404 len: 111 microversion: 2.1 time: 0.069771 Aug 18 14:30:24.183718 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93d067cf-a4ef-44f7-9553-c7b2ff5f8a15 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:24.183834 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 315/627] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:24 2022] GET /compute/v2.1/servers/222bc1f0-96b3-4d29-960a-39437b4dc0a5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:30:24.353234 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-93d067cf-a4ef-44f7-9553-c7b2ff5f8a15 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Invalid volume: volume 05ac1dd3-a553-4fbd-83d6-a57a0ff444b2 is already attached to instances: ee35547b-560b-4510-a182-aae686f38082 Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-93d067cf-a4ef-44f7-9553-c7b2ff5f8a15 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: POST /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/os-volume_attachments HTTP/1.1 Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 74 Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:30:24.360192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:30:24.361495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:30:24.361495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:30:24.361495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:30:24.361495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:30:24.361495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:30:24.361495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:30:24.361495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:30:24.361495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:30:24.361495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:30:24.361495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Aug 18 14:30:24.361495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {"volumeAttachment": {"volumeId": "05ac1dd3-a553-4fbd-83d6-a57a0ff444b2"}} Aug 18 14:30:24.361495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Invalid volume: volume 05ac1dd3-a553-4fbd-83d6-a57a0ff444b2 is already attached to instances: ee35547b-560b-4510-a182-aae686f38082 Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'server_id': 'ee35547b-560b-4510-a182-aae686f38082', 'body': {'volumeAttachment': {'volumeId': '05ac1dd3-a553-4fbd-83d6-a57a0ff444b2'}}} Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5122, in attach_volume Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4962, in _check_volume_already_attached Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 05ac1dd3-a553-4fbd-83d6-a57a0ff444b2 is already attached to instances: ee35547b-560b-4510-a182-aae686f38082 Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:24.363053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 05ac1dd3-a553-4fbd-83d6-a57a0ff444b2 is already attached to instances: ee35547b-560b-4510-a182-aae686f38082 Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:24.364325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:30:24.365500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:30:24.365500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:30:24.365500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:30:24.365500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 05ac1dd3-a553-4fbd-83d6-a57a0ff444b2 is already attached to instances: ee35547b-560b-4510-a182-aae686f38082 Aug 18 14:30:24.365500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:24.365500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-93d067cf-a4ef-44f7-9553-c7b2ff5f8a15 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 400 to user: Invalid volume: volume 05ac1dd3-a553-4fbd-83d6-a57a0ff444b2 is already attached to instances: ee35547b-560b-4510-a182-aae686f38082 {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:30:24.365500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-93d067cf-a4ef-44f7-9553-c7b2ff5f8a15 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "POST /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.204537 Aug 18 14:30:24.371661 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 313/628] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:30:24 2022] POST /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/os-volume_attachments => generated 174 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:30:24.476059 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2f2fc3e3-0e8d-4df1-b95d-fd592dfbccc2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:24.476836 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2f2fc3e3-0e8d-4df1-b95d-fd592dfbccc2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:24.484393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f2fc3e3-0e8d-4df1-b95d-fd592dfbccc2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:24.485109 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f2fc3e3-0e8d-4df1-b95d-fd592dfbccc2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:24.486665 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f2fc3e3-0e8d-4df1-b95d-fd592dfbccc2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:24.488395 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f2fc3e3-0e8d-4df1-b95d-fd592dfbccc2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:24.491016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f2fc3e3-0e8d-4df1-b95d-fd592dfbccc2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:24.491679 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f2fc3e3-0e8d-4df1-b95d-fd592dfbccc2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:24.653323 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-2f2fc3e3-0e8d-4df1-b95d-fd592dfbccc2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lazy-loading 'services' on Instance uuid ee35547b-560b-4510-a182-aae686f38082 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:30:24.794438 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2f2fc3e3-0e8d-4df1-b95d-fd592dfbccc2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/os-volume_attachments/05ac1dd3-a553-4fbd-83d6-a57a0ff444b2" status: 202 len: 0 microversion: 2.1 time: 0.322977 Aug 18 14:30:24.798467 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 316/629] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Aug 18 14:30:24 2022] DELETE /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/os-volume_attachments/05ac1dd3-a553-4fbd-83d6-a57a0ff444b2 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:30:24.805464 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bc9a399c-3c31-4bb2-8552-6ec0abefe96a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:24.809045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bc9a399c-3c31-4bb2-8552-6ec0abefe96a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:24.828665 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc9a399c-3c31-4bb2-8552-6ec0abefe96a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:24.833486 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc9a399c-3c31-4bb2-8552-6ec0abefe96a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:24.834203 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc9a399c-3c31-4bb2-8552-6ec0abefe96a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:24.840594 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc9a399c-3c31-4bb2-8552-6ec0abefe96a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:24.841885 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc9a399c-3c31-4bb2-8552-6ec0abefe96a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:24.842539 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc9a399c-3c31-4bb2-8552-6ec0abefe96a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:24.961199 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bc9a399c-3c31-4bb2-8552-6ec0abefe96a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160873 Aug 18 14:30:24.962551 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 314/630] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:30:24 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:25.645410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-fccd6e81-17a7-4cb8-93e0-e611b5b51d97 req-3dbac5e0-ed99-42c4-80bf-e3c81b77eea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "910c9fdb-a6d3-4e60-843e-9e65d037ea71", "tag": "7ce6f5b2-32fa-4a9b-b50f-f6c24b537da8"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:25.658448 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-fccd6e81-17a7-4cb8-93e0-e611b5b51d97 req-3dbac5e0-ed99-42c4-80bf-e3c81b77eea3 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:25.659878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-fccd6e81-17a7-4cb8-93e0-e611b5b51d97 req-3dbac5e0-ed99-42c4-80bf-e3c81b77eea3 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:25.660496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-fccd6e81-17a7-4cb8-93e0-e611b5b51d97 req-3dbac5e0-ed99-42c4-80bf-e3c81b77eea3 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:25.677558 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-fccd6e81-17a7-4cb8-93e0-e611b5b51d97 req-3dbac5e0-ed99-42c4-80bf-e3c81b77eea3 service nova] Creating event network-changed:7ce6f5b2-32fa-4a9b-b50f-f6c24b537da8 for instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 on hv-cinder-85220 Aug 18 14:30:25.685888 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-fccd6e81-17a7-4cb8-93e0-e611b5b51d97 req-3dbac5e0-ed99-42c4-80bf-e3c81b77eea3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046761 Aug 18 14:30:25.687321 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 317/631] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:25.735940 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8814b7eb-9a1c-4ff0-b71e-de6d4c3bd054 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Action: 'create', calling method: .version_select at 0x7fb6229f2670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-219290788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0d0Qb8hwjb/w6DSnMQzWnLjEdeUvT1ZUePMBNJGRpPiRw3qfguxe0jS5edXZ6yjgMS2EcMVvo/4ojrmJEbhjiRv9rYbUkOISplbzagqAusmleo4lbBe4vhUFtB9DgFgg=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:25.750995 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:25.767690 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-8814b7eb-9a1c-4ff0-b71e-de6d4c3bd054 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Getting quotas for project 7d21898f611b41e68cf9eb1b2f3edf8e. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:30:25.779258 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-8814b7eb-9a1c-4ff0-b71e-de6d4c3bd054 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Getting quotas for user b7454072c7944ae0b442885ac7660a90 and project 7d21898f611b41e68cf9eb1b2f3edf8e. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:30:25.814210 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8814b7eb-9a1c-4ff0-b71e-de6d4c3bd054 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.083283 Aug 18 14:30:25.816407 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 315/632] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Aug 18 14:30:25 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:25.886278 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1188116571", "imageRef": "2f7a8c0d-b06d-48d1-bc54-b963f08ddf80", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-219290788", "networks": [{"uuid": "4585a455-293e-42ae-99ec-773417a33dcb"}]}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:25.905700 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:25.955981 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] validate_networks() for [('4585a455-293e-42ae-99ec-773417a33dcb', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:30:25.975825 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6d5f29b7-5776-4fca-8dea-1de48f8060f3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:25.977737 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6d5f29b7-5776-4fca-8dea-1de48f8060f3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:25.985104 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d5f29b7-5776-4fca-8dea-1de48f8060f3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:25.985737 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d5f29b7-5776-4fca-8dea-1de48f8060f3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:25.986285 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d5f29b7-5776-4fca-8dea-1de48f8060f3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:25.987678 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d5f29b7-5776-4fca-8dea-1de48f8060f3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:25.988332 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d5f29b7-5776-4fca-8dea-1de48f8060f3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:25.988865 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d5f29b7-5776-4fca-8dea-1de48f8060f3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:26.036768 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6d5f29b7-5776-4fca-8dea-1de48f8060f3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066407 Aug 18 14:30:26.038442 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 316/633] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:30:25 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 14:30:26.108774 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f723fa3b-815a-4c0d-b10d-ddcf2d8c30d3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:26.109898 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f723fa3b-815a-4c0d-b10d-ddcf2d8c30d3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:26.120889 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f723fa3b-815a-4c0d-b10d-ddcf2d8c30d3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:26.121537 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f723fa3b-815a-4c0d-b10d-ddcf2d8c30d3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:26.122084 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f723fa3b-815a-4c0d-b10d-ddcf2d8c30d3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:26.123497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f723fa3b-815a-4c0d-b10d-ddcf2d8c30d3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:26.123497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f723fa3b-815a-4c0d-b10d-ddcf2d8c30d3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:26.123988 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f723fa3b-815a-4c0d-b10d-ddcf2d8c30d3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:26.155650 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f723fa3b-815a-4c0d-b10d-ddcf2d8c30d3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:30:26.292337 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f723fa3b-815a-4c0d-b10d-ddcf2d8c30d3 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 204 len: 0 microversion: 2.1 time: 0.187412 Aug 18 14:30:26.293202 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 317/634] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:30:26 2022] DELETE /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:30:26.313534 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-641e4b92-2dd8-4fe0-903e-094f57cdaa4f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:26.319548 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-641e4b92-2dd8-4fe0-903e-094f57cdaa4f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:26.337733 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-641e4b92-2dd8-4fe0-903e-094f57cdaa4f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:26.338568 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-641e4b92-2dd8-4fe0-903e-094f57cdaa4f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:26.340049 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-641e4b92-2dd8-4fe0-903e-094f57cdaa4f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:26.341043 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-641e4b92-2dd8-4fe0-903e-094f57cdaa4f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:26.341875 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-641e4b92-2dd8-4fe0-903e-094f57cdaa4f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:26.342399 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-641e4b92-2dd8-4fe0-903e-094f57cdaa4f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:26.633495 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:30:26.634279 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:30:26.634699 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:30:26.635038 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:30:26.635475 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:30:26.646836 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:26.648596 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:26.649864 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:26.650006 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:26.650386 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:26.650984 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:26.672510 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Getting quotas for project 7d21898f611b41e68cf9eb1b2f3edf8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:30:26.677929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Getting quotas for user b7454072c7944ae0b442885ac7660a90 and project 7d21898f611b41e68cf9eb1b2f3edf8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:30:26.689747 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:30:26.693244 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f7a8c0d-b06d-48d1-bc54-b963f08ddf80',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:30:26.707427 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-641e4b92-2dd8-4fe0-903e-094f57cdaa4f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:26.716132 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-641e4b92-2dd8-4fe0-903e-094f57cdaa4f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1677 microversion: 2.1 time: 0.416483 Aug 18 14:30:26.717439 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 318/635] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:26 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1677 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:26.754579 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c6d3fb6e-89cc-42c6-a5f3-cd6f2183ed54 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872757 Aug 18 14:30:26.755880 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 318/636] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:30:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:30:26.767411 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fab6a7e5-3f4d-4825-aaab-afd697858197 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:26.768153 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fab6a7e5-3f4d-4825-aaab-afd697858197 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:26.847337 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fab6a7e5-3f4d-4825-aaab-afd697858197 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:26.854696 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fab6a7e5-3f4d-4825-aaab-afd697858197 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1258 microversion: 2.1 time: 0.090990 Aug 18 14:30:26.855788 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 319/637] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:26 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1258 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:27.739803 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fd4390e8-9c14-41b6-ba8b-f64be491e38b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:27.741032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fd4390e8-9c14-41b6-ba8b-f64be491e38b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:27.750092 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd4390e8-9c14-41b6-ba8b-f64be491e38b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:27.750832 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd4390e8-9c14-41b6-ba8b-f64be491e38b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:27.751458 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd4390e8-9c14-41b6-ba8b-f64be491e38b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:27.752475 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd4390e8-9c14-41b6-ba8b-f64be491e38b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:27.753253 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd4390e8-9c14-41b6-ba8b-f64be491e38b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:27.754176 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd4390e8-9c14-41b6-ba8b-f64be491e38b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:27.877815 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e847fa28-777f-4814-a550-662e36f218ed tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:27.879604 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e847fa28-777f-4814-a550-662e36f218ed tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:27.886490 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e847fa28-777f-4814-a550-662e36f218ed tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:27.887178 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e847fa28-777f-4814-a550-662e36f218ed tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:27.887825 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e847fa28-777f-4814-a550-662e36f218ed tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:27.888525 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e847fa28-777f-4814-a550-662e36f218ed tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:27.889273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e847fa28-777f-4814-a550-662e36f218ed tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:27.889704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e847fa28-777f-4814-a550-662e36f218ed tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:27.910530 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:27.963282 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fd4390e8-9c14-41b6-ba8b-f64be491e38b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:27.972153 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fd4390e8-9c14-41b6-ba8b-f64be491e38b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1677 microversion: 2.1 time: 0.237345 Aug 18 14:30:27.973277 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 319/638] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:27 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:28.236183 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e847fa28-777f-4814-a550-662e36f218ed tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:28.252178 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e847fa28-777f-4814-a550-662e36f218ed tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1310 microversion: 2.1 time: 0.378835 Aug 18 14:30:28.254931 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 320/639] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:27 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1310 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:28.997631 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-752913fe-adde-4031-a7bb-fb03353097f7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:28.998818 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-752913fe-adde-4031-a7bb-fb03353097f7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:29.023985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-752913fe-adde-4031-a7bb-fb03353097f7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:29.024539 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-752913fe-adde-4031-a7bb-fb03353097f7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:29.025009 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-752913fe-adde-4031-a7bb-fb03353097f7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:29.037380 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-752913fe-adde-4031-a7bb-fb03353097f7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:29.039545 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-752913fe-adde-4031-a7bb-fb03353097f7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:29.042492 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-752913fe-adde-4031-a7bb-fb03353097f7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:29.135696 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=92,nova_cell1:INSERT=4 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:29.287873 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-249fabb8-40d5-431a-bd79-1e3466568cfe tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:29.289243 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-249fabb8-40d5-431a-bd79-1e3466568cfe tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:29.312754 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249fabb8-40d5-431a-bd79-1e3466568cfe tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:29.320489 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249fabb8-40d5-431a-bd79-1e3466568cfe tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:29.321565 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249fabb8-40d5-431a-bd79-1e3466568cfe tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:29.324049 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249fabb8-40d5-431a-bd79-1e3466568cfe tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:29.330273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249fabb8-40d5-431a-bd79-1e3466568cfe tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:29.336384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249fabb8-40d5-431a-bd79-1e3466568cfe tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:29.492912 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-752913fe-adde-4031-a7bb-fb03353097f7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:29.521074 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-752913fe-adde-4031-a7bb-fb03353097f7 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1677 microversion: 2.1 time: 0.527748 Aug 18 14:30:29.522590 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 320/640] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:28 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1677 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:29.626447 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-249fabb8-40d5-431a-bd79-1e3466568cfe tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:29.637813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-249fabb8-40d5-431a-bd79-1e3466568cfe tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1316 microversion: 2.1 time: 0.357223 Aug 18 14:30:29.638356 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 321/641] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:29 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:30:30.555769 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c1602bf4-2d29-49cf-93a0-36902cd6af3a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:30.557084 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c1602bf4-2d29-49cf-93a0-36902cd6af3a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:30.574363 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1602bf4-2d29-49cf-93a0-36902cd6af3a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:30.574933 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1602bf4-2d29-49cf-93a0-36902cd6af3a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:30.575447 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1602bf4-2d29-49cf-93a0-36902cd6af3a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:30.576229 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1602bf4-2d29-49cf-93a0-36902cd6af3a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:30.576751 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1602bf4-2d29-49cf-93a0-36902cd6af3a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:30.577241 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1602bf4-2d29-49cf-93a0-36902cd6af3a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:30.664019 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9e3c1dc3-de12-489c-bfd3-035d4d4c4ba4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:30.664748 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9e3c1dc3-de12-489c-bfd3-035d4d4c4ba4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:30.680991 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e3c1dc3-de12-489c-bfd3-035d4d4c4ba4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:30.683505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e3c1dc3-de12-489c-bfd3-035d4d4c4ba4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:30.683505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e3c1dc3-de12-489c-bfd3-035d4d4c4ba4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:30.689648 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e3c1dc3-de12-489c-bfd3-035d4d4c4ba4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:30.690362 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e3c1dc3-de12-489c-bfd3-035d4d4c4ba4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:30.690786 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e3c1dc3-de12-489c-bfd3-035d4d4c4ba4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:30.791458 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c1602bf4-2d29-49cf-93a0-36902cd6af3a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:30.810446 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c1602bf4-2d29-49cf-93a0-36902cd6af3a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1610 microversion: 2.1 time: 0.270352 Aug 18 14:30:30.814072 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 321/642] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:30 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1610 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:31.034979 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e3c1dc3-de12-489c-bfd3-035d4d4c4ba4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:31.059708 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9e3c1dc3-de12-489c-bfd3-035d4d4c4ba4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1358 microversion: 2.1 time: 0.401291 Aug 18 14:30:31.064309 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 322/643] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:30 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1358 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:31.838370 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:31.839701 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:31.859783 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:31.870573 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:31.870573 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:31.870573 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:31.870573 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:31.870970 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:31.952253 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-cf2482da-fe0f-43fe-beb3-1dce310c4b44 req-1b775d5f-64d2-46c0-b1e9-eb0f98ca4f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee35547b-560b-4510-a182-aae686f38082", "name": "network-vif-deleted", "tag": "436f8533-78b5-46d1-b635-ee6a7c8d2cbc"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:31.962362 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:31.962362 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:31.962996 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:31.963722 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lazy-loading 'fault' on Instance uuid ee35547b-560b-4510-a182-aae686f38082 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:30:31.984528 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-cf2482da-fe0f-43fe-beb3-1dce310c4b44 req-1b775d5f-64d2-46c0-b1e9-eb0f98ca4f8a service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:31.985286 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-cf2482da-fe0f-43fe-beb3-1dce310c4b44 req-1b775d5f-64d2-46c0-b1e9-eb0f98ca4f8a service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:31.985887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-cf2482da-fe0f-43fe-beb3-1dce310c4b44 req-1b775d5f-64d2-46c0-b1e9-eb0f98ca4f8a service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:32.005755 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-cf2482da-fe0f-43fe-beb3-1dce310c4b44 req-1b775d5f-64d2-46c0-b1e9-eb0f98ca4f8a service nova] Creating event network-vif-deleted:436f8533-78b5-46d1-b635-ee6a7c8d2cbc for instance ee35547b-560b-4510-a182-aae686f38082 on hv-cinder-85220 Aug 18 14:30:32.021360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-cf2482da-fe0f-43fe-beb3-1dce310c4b44 req-1b775d5f-64d2-46c0-b1e9-eb0f98ca4f8a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.706481 Aug 18 14:30:32.022481 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 322/644] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:32.042440 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:32.072686 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-629194b6-498c-491a-a5d1-ad353dfce505 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 200 len: 1330 microversion: 2.1 time: 0.239834 Aug 18 14:30:32.089087 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-21e62c3a-58f0-41cd-9200-c008b59ea883 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:32.090436 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-21e62c3a-58f0-41cd-9200-c008b59ea883 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:32.100013 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 323/645] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:31 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 1330 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:32.101962 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21e62c3a-58f0-41cd-9200-c008b59ea883 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:32.109213 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21e62c3a-58f0-41cd-9200-c008b59ea883 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:32.115332 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21e62c3a-58f0-41cd-9200-c008b59ea883 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:32.116876 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21e62c3a-58f0-41cd-9200-c008b59ea883 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:32.118764 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21e62c3a-58f0-41cd-9200-c008b59ea883 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:32.119637 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21e62c3a-58f0-41cd-9200-c008b59ea883 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:32.697886 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-21e62c3a-58f0-41cd-9200-c008b59ea883 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:32.709882 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-21e62c3a-58f0-41cd-9200-c008b59ea883 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1358 microversion: 2.1 time: 0.625721 Aug 18 14:30:32.711441 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 323/646] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:32 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1358 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:33.121977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b692b6a3-9ff6-4bad-af25-2bf77a1285ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:33.122691 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b692b6a3-9ff6-4bad-af25-2bf77a1285ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:33.139187 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b692b6a3-9ff6-4bad-af25-2bf77a1285ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:33.140288 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b692b6a3-9ff6-4bad-af25-2bf77a1285ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:33.141350 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b692b6a3-9ff6-4bad-af25-2bf77a1285ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:33.142893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b692b6a3-9ff6-4bad-af25-2bf77a1285ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:33.147640 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b692b6a3-9ff6-4bad-af25-2bf77a1285ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:33.149092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b692b6a3-9ff6-4bad-af25-2bf77a1285ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:33.187539 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-b692b6a3-9ff6-4bad-af25-2bf77a1285ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b692b6a3-9ff6-4bad-af25-2bf77a1285ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 HTTP/1.1 Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:30:33.189390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:30:33.191314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:30:33.191314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:30:33.191314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:30:33.191314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:30:33.191314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:30:33.191314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:30:33.191314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:30:33.191314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:30:33.191314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:30:33.191314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:30:33.191314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:30:33.191314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': 'ee35547b-560b-4510-a182-aae686f38082'} Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:30:33.192273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:30:33.193947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:30:33.198306 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b692b6a3-9ff6-4bad-af25-2bf77a1285ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 404 to user: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:30:33.204192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b692b6a3-9ff6-4bad-af25-2bf77a1285ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 404 len: 111 microversion: 2.1 time: 0.086792 Aug 18 14:30:33.206858 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 324/647] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:33 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:30:33.218259 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a1bb006a-dbf1-464f-8510-c1a58f89eda1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '.version_select at 0x7fb621f758b0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:33.280909 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a1bb006a-dbf1-464f-8510-c1a58f89eda1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-411773349" status: 202 len: 0 microversion: 2.1 time: 0.067971 Aug 18 14:30:33.281871 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 324/648] 10.222.0.39 () {58 vars in 1218 bytes} [Thu Aug 18 14:30:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-411773349 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:30:33.733637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d1fb9f0-a9b5-4ea8-b108-3bb029553c06 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:33.734743 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7d1fb9f0-a9b5-4ea8-b108-3bb029553c06 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:33.750964 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d1fb9f0-a9b5-4ea8-b108-3bb029553c06 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:33.757615 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d1fb9f0-a9b5-4ea8-b108-3bb029553c06 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:33.757615 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d1fb9f0-a9b5-4ea8-b108-3bb029553c06 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:33.758851 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d1fb9f0-a9b5-4ea8-b108-3bb029553c06 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:33.760004 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d1fb9f0-a9b5-4ea8-b108-3bb029553c06 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:33.764511 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d1fb9f0-a9b5-4ea8-b108-3bb029553c06 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:34.160773 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-7b211f33-81c9-498c-938d-722326cfb508 req-bf319645-7f55-4b39-a12d-5f8a2c3f7525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f291a369-1330-40f8-b4fc-d6af6b3afa1b", "tag": "6a55ee51-1001-4a61-a93a-c6e99dbaa47a"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:34.203544 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-7b211f33-81c9-498c-938d-722326cfb508 req-bf319645-7f55-4b39-a12d-5f8a2c3f7525 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:34.204339 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-7b211f33-81c9-498c-938d-722326cfb508 req-bf319645-7f55-4b39-a12d-5f8a2c3f7525 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:34.205018 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-7b211f33-81c9-498c-938d-722326cfb508 req-bf319645-7f55-4b39-a12d-5f8a2c3f7525 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:34.233448 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-7b211f33-81c9-498c-938d-722326cfb508 req-bf319645-7f55-4b39-a12d-5f8a2c3f7525 service nova] Creating event network-changed:6a55ee51-1001-4a61-a93a-c6e99dbaa47a for instance f291a369-1330-40f8-b4fc-d6af6b3afa1b on hv-cinder-85220 Aug 18 14:30:34.249085 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-7b211f33-81c9-498c-938d-722326cfb508 req-bf319645-7f55-4b39-a12d-5f8a2c3f7525 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092042 Aug 18 14:30:34.249666 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 325/649] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:34.424601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7d1fb9f0-a9b5-4ea8-b108-3bb029553c06 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:34.444613 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d1fb9f0-a9b5-4ea8-b108-3bb029553c06 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1358 microversion: 2.1 time: 0.715634 Aug 18 14:30:34.446197 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 325/650] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:33 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1358 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:35.389286 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-48a6bed7-0106-40ef-8023-e65a80ef4157 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Action: 'create', calling method: .version_select at 0x7fb621fa7e50>, body: {"keypair": {"name": "tempest-keypair-228649418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVnzIPkKd8UXFCNlLSLEjIKhyWAt35De2ROiw9e+x4x7KYSH/QSD4y5DJELDuI1d1XLHx2NdIT8vSHjRGwpzDxZ1yLI4FeGKO4L2y9rdfsblIo71qK2nqJ1mxGGTdwsmQ=="}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:35.453266 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-48a6bed7-0106-40ef-8023-e65a80ef4157 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:30:35.470803 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e382d690-0405-4e59-ac20-79679422affd tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:35.473463 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e382d690-0405-4e59-ac20-79679422affd tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:35.491928 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-48a6bed7-0106-40ef-8023-e65a80ef4157 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for user 5972d1e96fa04d52983ac6f201d7772c and project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:30:35.497951 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e382d690-0405-4e59-ac20-79679422affd tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:35.505234 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e382d690-0405-4e59-ac20-79679422affd tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:35.509939 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e382d690-0405-4e59-ac20-79679422affd tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:35.511036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e382d690-0405-4e59-ac20-79679422affd tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:35.512236 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e382d690-0405-4e59-ac20-79679422affd tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:35.512938 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e382d690-0405-4e59-ac20-79679422affd tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:35.593874 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-48a6bed7-0106-40ef-8023-e65a80ef4157 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.213136 Aug 18 14:30:35.596235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 326/651] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Aug 18 14:30:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:36.346673 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e382d690-0405-4e59-ac20-79679422affd tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:36.379337 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e382d690-0405-4e59-ac20-79679422affd tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1358 microversion: 2.1 time: 0.916864 Aug 18 14:30:36.383166 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 326/652] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:35 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1358 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:30:37.407608 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-25711ca7-0f12-4c9e-ab99-ec78cf481396 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:37.409697 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-25711ca7-0f12-4c9e-ab99-ec78cf481396 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:37.437036 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:37.444632 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25711ca7-0f12-4c9e-ab99-ec78cf481396 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:37.448602 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25711ca7-0f12-4c9e-ab99-ec78cf481396 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:37.449182 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25711ca7-0f12-4c9e-ab99-ec78cf481396 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:37.451823 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25711ca7-0f12-4c9e-ab99-ec78cf481396 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:37.452758 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25711ca7-0f12-4c9e-ab99-ec78cf481396 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:37.453548 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25711ca7-0f12-4c9e-ab99-ec78cf481396 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:37.951926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-25711ca7-0f12-4c9e-ab99-ec78cf481396 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:37.974855 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-25711ca7-0f12-4c9e-ab99-ec78cf481396 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1358 microversion: 2.1 time: 0.571583 Aug 18 14:30:37.979092 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 327/653] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:37 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1358 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:39.003218 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-826edbdb-83e6-4638-862c-c3fd56502141 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:39.004559 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-826edbdb-83e6-4638-862c-c3fd56502141 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:39.015902 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:39.024406 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-826edbdb-83e6-4638-862c-c3fd56502141 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:39.025457 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-826edbdb-83e6-4638-862c-c3fd56502141 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:39.027257 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-826edbdb-83e6-4638-862c-c3fd56502141 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:39.029561 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-826edbdb-83e6-4638-862c-c3fd56502141 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:39.031424 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-826edbdb-83e6-4638-862c-c3fd56502141 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:39.033485 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-826edbdb-83e6-4638-862c-c3fd56502141 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:39.328893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-826edbdb-83e6-4638-862c-c3fd56502141 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:39.340430 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-826edbdb-83e6-4638-862c-c3fd56502141 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1358 microversion: 2.1 time: 0.343192 Aug 18 14:30:39.341889 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 327/654] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:38 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1358 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:40.362942 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-190cb6ef-e237-4871-8442-d49cbdcc00b4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:40.363601 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-190cb6ef-e237-4871-8442-d49cbdcc00b4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:40.371955 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-190cb6ef-e237-4871-8442-d49cbdcc00b4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:40.374390 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-190cb6ef-e237-4871-8442-d49cbdcc00b4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:40.375102 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-190cb6ef-e237-4871-8442-d49cbdcc00b4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:40.376896 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-190cb6ef-e237-4871-8442-d49cbdcc00b4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:40.377597 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-190cb6ef-e237-4871-8442-d49cbdcc00b4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:40.378269 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-190cb6ef-e237-4871-8442-d49cbdcc00b4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:40.447393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-999720617", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ce7c320a-581c-4aa3-85bd-1646d1f4ed3c"}], "security_groups": [{"name": "tempest-securitygroup--1705781869"}], "key_name": "tempest-keypair-228649418", "user_data": "}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:40.587844 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] validate_networks() for [('ce7c320a-581c-4aa3-85bd-1646d1f4ed3c', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:30:40.650517 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-190cb6ef-e237-4871-8442-d49cbdcc00b4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:40.663575 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-190cb6ef-e237-4871-8442-d49cbdcc00b4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1358 microversion: 2.1 time: 0.305237 Aug 18 14:30:40.664428 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 328/655] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:40 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1358 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:30:41.204227 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:30:41.205614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:30:41.210364 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:30:41.211358 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:30:41.212340 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:30:41.231849 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:41.232350 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:41.232789 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:41.233718 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:41.234178 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:41.234608 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:41.256816 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:30:41.266359 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Getting quotas for user 5972d1e96fa04d52983ac6f201d7772c and project 31e7d0fb80204fc99b0e3ad583a9eedf. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:30:41.287984 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:30:41.291334 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:30:41.364708 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-86a56c6c-d7be-45ba-bcdd-41fd7f1dc0b2 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.922152 Aug 18 14:30:41.365781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 328/656] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:30:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:30:41.376254 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f401c3fa-89b9-47c3-9e5c-4e50bbfa9ca8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:41.377316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f401c3fa-89b9-47c3-9e5c-4e50bbfa9ca8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:41.537659 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f401c3fa-89b9-47c3-9e5c-4e50bbfa9ca8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:41.561062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f401c3fa-89b9-47c3-9e5c-4e50bbfa9ca8 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1240 microversion: 2.1 time: 0.188661 Aug 18 14:30:41.565893 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 329/657] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:41 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1240 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:41.694964 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-44799a36-461e-48e9-bd87-0d51c1b152d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:41.696440 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-44799a36-461e-48e9-bd87-0d51c1b152d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:41.704442 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44799a36-461e-48e9-bd87-0d51c1b152d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:41.706123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44799a36-461e-48e9-bd87-0d51c1b152d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:41.706895 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44799a36-461e-48e9-bd87-0d51c1b152d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:41.708059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44799a36-461e-48e9-bd87-0d51c1b152d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:41.708760 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44799a36-461e-48e9-bd87-0d51c1b152d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:41.709459 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44799a36-461e-48e9-bd87-0d51c1b152d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:42.008561 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-44799a36-461e-48e9-bd87-0d51c1b152d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:42.020238 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-44799a36-461e-48e9-bd87-0d51c1b152d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1358 microversion: 2.1 time: 0.338668 Aug 18 14:30:42.021333 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 329/658] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:41 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1358 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:42.454340 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9b48a7df-c9e3-4b20-9aa0-17bedb4c4d63 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Action: 'create', calling method: .version_select at 0x7fb621f97c10>, body: {"keypair": {"name": "tempest-keypair-1922625841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLucdNNaMvSoqKnTdDg1blMtluic8m5QTZscqyTkD1tYDw5+QSctd58Jm6SJHT5VU0zNE/lmhK2GBKYelFEFeR8TyDpsGluqt3CAgw0DnRvNDvuOEGFPO7VcfklcQoH/QQ=="}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:42.473328 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-9b48a7df-c9e3-4b20-9aa0-17bedb4c4d63 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Getting quotas for project ac3936135be542a4a1e0370bac465278. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:30:42.477072 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-9b48a7df-c9e3-4b20-9aa0-17bedb4c4d63 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Getting quotas for user 660aa77ae39a47e8b3b607d0839ed3dc and project ac3936135be542a4a1e0370bac465278. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:30:42.503934 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9b48a7df-c9e3-4b20-9aa0-17bedb4c4d63 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.209385 Aug 18 14:30:42.505052 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 330/659] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Aug 18 14:30:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:42.586261 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b13338b9-085c-4227-a6e0-7fdb16a0f7e0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:42.586878 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b13338b9-085c-4227-a6e0-7fdb16a0f7e0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:42.597362 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b13338b9-085c-4227-a6e0-7fdb16a0f7e0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:42.597862 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b13338b9-085c-4227-a6e0-7fdb16a0f7e0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:42.598302 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b13338b9-085c-4227-a6e0-7fdb16a0f7e0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:42.599001 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b13338b9-085c-4227-a6e0-7fdb16a0f7e0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:42.599487 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b13338b9-085c-4227-a6e0-7fdb16a0f7e0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:42.599912 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b13338b9-085c-4227-a6e0-7fdb16a0f7e0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:42.700399 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b13338b9-085c-4227-a6e0-7fdb16a0f7e0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:42.712836 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b13338b9-085c-4227-a6e0-7fdb16a0f7e0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1292 microversion: 2.1 time: 0.130469 Aug 18 14:30:42.739255 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 330/660] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:42 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1292 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:43.047982 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-209a99aa-dcc7-43ee-a4b2-5c849fc76c40 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:43.049410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-209a99aa-dcc7-43ee-a4b2-5c849fc76c40 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:43.056053 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-209a99aa-dcc7-43ee-a4b2-5c849fc76c40 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:43.056774 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-209a99aa-dcc7-43ee-a4b2-5c849fc76c40 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:43.057454 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-209a99aa-dcc7-43ee-a4b2-5c849fc76c40 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:43.059159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-209a99aa-dcc7-43ee-a4b2-5c849fc76c40 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:43.059978 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-209a99aa-dcc7-43ee-a4b2-5c849fc76c40 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:43.060953 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-209a99aa-dcc7-43ee-a4b2-5c849fc76c40 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:43.428663 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-209a99aa-dcc7-43ee-a4b2-5c849fc76c40 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:43.442974 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-209a99aa-dcc7-43ee-a4b2-5c849fc76c40 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1358 microversion: 2.1 time: 0.404617 Aug 18 14:30:43.444403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 331/661] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:43 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1358 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:43.747750 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e890e2c3-620c-4d20-927b-0f1199a4943d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:43.749242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e890e2c3-620c-4d20-927b-0f1199a4943d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:43.757193 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e890e2c3-620c-4d20-927b-0f1199a4943d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:43.758941 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e890e2c3-620c-4d20-927b-0f1199a4943d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:43.759700 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e890e2c3-620c-4d20-927b-0f1199a4943d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:43.763575 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e890e2c3-620c-4d20-927b-0f1199a4943d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:43.764301 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e890e2c3-620c-4d20-927b-0f1199a4943d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:43.764943 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e890e2c3-620c-4d20-927b-0f1199a4943d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:43.885400 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e890e2c3-620c-4d20-927b-0f1199a4943d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:43.900518 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e890e2c3-620c-4d20-927b-0f1199a4943d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1298 microversion: 2.1 time: 0.155034 Aug 18 14:30:43.917666 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 331/662] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:43 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1298 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:44.472695 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d6eb12a4-0830-4d2c-89d0-47059a510caa tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:44.473449 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d6eb12a4-0830-4d2c-89d0-47059a510caa tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:44.491619 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6eb12a4-0830-4d2c-89d0-47059a510caa tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:44.492261 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6eb12a4-0830-4d2c-89d0-47059a510caa tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:44.493048 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6eb12a4-0830-4d2c-89d0-47059a510caa tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:44.499877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6eb12a4-0830-4d2c-89d0-47059a510caa tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:44.500760 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6eb12a4-0830-4d2c-89d0-47059a510caa tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:44.504411 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6eb12a4-0830-4d2c-89d0-47059a510caa tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:44.752941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d6eb12a4-0830-4d2c-89d0-47059a510caa tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:44.764138 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d6eb12a4-0830-4d2c-89d0-47059a510caa tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1358 microversion: 2.1 time: 0.302361 Aug 18 14:30:44.773732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1078446201", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77c79277-fde9-4b51-a36d-6832024b6513"}], "security_groups": [{"name": "tempest-securitygroup--2074293205"}], "key_name": "tempest-keypair-1922625841", "user_data": "}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:44.778803 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 332/663] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:44 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:44.925041 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] validate_networks() for [('77c79277-fde9-4b51-a36d-6832024b6513', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:30:44.947608 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e34bc72e-09d9-4231-88ba-0b8156bb5d78 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:44.950021 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e34bc72e-09d9-4231-88ba-0b8156bb5d78 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:44.974227 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e34bc72e-09d9-4231-88ba-0b8156bb5d78 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:44.974589 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e34bc72e-09d9-4231-88ba-0b8156bb5d78 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:44.975034 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e34bc72e-09d9-4231-88ba-0b8156bb5d78 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:44.977216 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e34bc72e-09d9-4231-88ba-0b8156bb5d78 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:44.978010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e34bc72e-09d9-4231-88ba-0b8156bb5d78 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:44.978381 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e34bc72e-09d9-4231-88ba-0b8156bb5d78 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:45.335359 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e34bc72e-09d9-4231-88ba-0b8156bb5d78 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:45.345896 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e34bc72e-09d9-4231-88ba-0b8156bb5d78 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1366 microversion: 2.1 time: 0.409951 Aug 18 14:30:45.360522 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 333/664] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:44 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:45.369322 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-63f8b593-abbf-4fa2-ae36-2886f606bab8 req-bb171431-ed25-433b-bec3-15530bb0b227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d8b41d-49fe-4ffd-9896-33f4a20a437b", "tag": "e29f52c7-443d-4909-adc8-b988297386bb"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:45.397424 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-63f8b593-abbf-4fa2-ae36-2886f606bab8 req-bb171431-ed25-433b-bec3-15530bb0b227 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:45.397923 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-63f8b593-abbf-4fa2-ae36-2886f606bab8 req-bb171431-ed25-433b-bec3-15530bb0b227 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:45.398367 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-63f8b593-abbf-4fa2-ae36-2886f606bab8 req-bb171431-ed25-433b-bec3-15530bb0b227 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:45.417589 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-63f8b593-abbf-4fa2-ae36-2886f606bab8 req-bb171431-ed25-433b-bec3-15530bb0b227 service nova] Creating event network-changed:e29f52c7-443d-4909-adc8-b988297386bb for instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b on hv-cinder-85220 Aug 18 14:30:45.422798 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-63f8b593-abbf-4fa2-ae36-2886f606bab8 req-bb171431-ed25-433b-bec3-15530bb0b227 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060847 Aug 18 14:30:45.423845 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 334/665] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:45.484925 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:30:45.486774 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:30:45.487469 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:30:45.488040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:30:45.488613 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:30:45.500953 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:45.503006 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:45.504828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:45.507204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:45.507900 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:45.508520 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:45.529403 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Getting quotas for project ac3936135be542a4a1e0370bac465278. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:30:45.536209 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Getting quotas for user 660aa77ae39a47e8b3b607d0839ed3dc and project ac3936135be542a4a1e0370bac465278. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:30:45.549658 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:30:45.553210 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:30:45.617839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-575e128e-934e-43b6-b161-353722ca8c1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.848395 Aug 18 14:30:45.624909 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 332/666] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:30:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:30:45.630232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-62474518-9714-4102-903e-5cd2655fe0c6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:45.630939 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-62474518-9714-4102-903e-5cd2655fe0c6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:45.707038 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-62474518-9714-4102-903e-5cd2655fe0c6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:45.726378 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-62474518-9714-4102-903e-5cd2655fe0c6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1238 microversion: 2.1 time: 0.100201 Aug 18 14:30:45.727537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 335/667] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:45 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:45.787330 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f22dbfd6-978d-4a43-b2cc-70b3c1f4a6ac tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:45.788163 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f22dbfd6-978d-4a43-b2cc-70b3c1f4a6ac tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:45.800936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f22dbfd6-978d-4a43-b2cc-70b3c1f4a6ac tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:45.801443 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f22dbfd6-978d-4a43-b2cc-70b3c1f4a6ac tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:45.801892 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f22dbfd6-978d-4a43-b2cc-70b3c1f4a6ac tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:45.802617 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f22dbfd6-978d-4a43-b2cc-70b3c1f4a6ac tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:45.803106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f22dbfd6-978d-4a43-b2cc-70b3c1f4a6ac tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:45.803516 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f22dbfd6-978d-4a43-b2cc-70b3c1f4a6ac tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:46.037188 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f22dbfd6-978d-4a43-b2cc-70b3c1f4a6ac tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:46.048776 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f22dbfd6-978d-4a43-b2cc-70b3c1f4a6ac tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1358 microversion: 2.1 time: 0.266456 Aug 18 14:30:46.062215 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 333/668] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:45 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:46.079714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-8d684386-c287-4e39-bf8a-5885d5429a7e req-815a2b51-397c-489c-b4e9-4a36afe1a145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f291a369-1330-40f8-b4fc-d6af6b3afa1b", "name": "network-vif-plugged", "status": "completed", "tag": "6a55ee51-1001-4a61-a93a-c6e99dbaa47a"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:46.090476 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-8d684386-c287-4e39-bf8a-5885d5429a7e req-815a2b51-397c-489c-b4e9-4a36afe1a145 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:46.090957 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-8d684386-c287-4e39-bf8a-5885d5429a7e req-815a2b51-397c-489c-b4e9-4a36afe1a145 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:46.091764 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-8d684386-c287-4e39-bf8a-5885d5429a7e req-815a2b51-397c-489c-b4e9-4a36afe1a145 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:46.103442 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-8d684386-c287-4e39-bf8a-5885d5429a7e req-815a2b51-397c-489c-b4e9-4a36afe1a145 service nova] Creating event network-vif-plugged:6a55ee51-1001-4a61-a93a-c6e99dbaa47a for instance f291a369-1330-40f8-b4fc-d6af6b3afa1b on hv-cinder-85220 Aug 18 14:30:46.108461 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-8d684386-c287-4e39-bf8a-5885d5429a7e req-815a2b51-397c-489c-b4e9-4a36afe1a145 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164761 Aug 18 14:30:46.109182 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 336/669] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:46.366760 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-96f972fd-1079-4484-b783-98533a83f478 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:46.367425 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-96f972fd-1079-4484-b783-98533a83f478 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:46.373329 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96f972fd-1079-4484-b783-98533a83f478 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:46.373806 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96f972fd-1079-4484-b783-98533a83f478 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:46.374239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96f972fd-1079-4484-b783-98533a83f478 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:46.374922 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96f972fd-1079-4484-b783-98533a83f478 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:46.375403 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96f972fd-1079-4484-b783-98533a83f478 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:46.375815 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96f972fd-1079-4484-b783-98533a83f478 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:46.504838 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-96f972fd-1079-4484-b783-98533a83f478 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:46.512485 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-96f972fd-1079-4484-b783-98533a83f478 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1366 microversion: 2.1 time: 0.149556 Aug 18 14:30:46.513046 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 334/670] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:46 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:46.752456 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4d2046d1-954f-4864-899e-868a27b01b6e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:46.753330 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4d2046d1-954f-4864-899e-868a27b01b6e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:46.760865 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d2046d1-954f-4864-899e-868a27b01b6e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:46.761609 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d2046d1-954f-4864-899e-868a27b01b6e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:46.762268 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d2046d1-954f-4864-899e-868a27b01b6e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:46.763136 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d2046d1-954f-4864-899e-868a27b01b6e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:46.763663 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d2046d1-954f-4864-899e-868a27b01b6e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:46.764095 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d2046d1-954f-4864-899e-868a27b01b6e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:46.831118 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4d2046d1-954f-4864-899e-868a27b01b6e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:46.839127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4d2046d1-954f-4864-899e-868a27b01b6e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1234 microversion: 2.1 time: 0.092673 Aug 18 14:30:46.839724 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 337/671] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:46 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1234 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:47.069607 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-854a1ab3-43ed-4c75-a401-e12b92905498 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:47.070140 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-854a1ab3-43ed-4c75-a401-e12b92905498 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:47.076793 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-854a1ab3-43ed-4c75-a401-e12b92905498 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:47.077289 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-854a1ab3-43ed-4c75-a401-e12b92905498 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:47.077701 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-854a1ab3-43ed-4c75-a401-e12b92905498 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:47.078398 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-854a1ab3-43ed-4c75-a401-e12b92905498 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:47.078885 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-854a1ab3-43ed-4c75-a401-e12b92905498 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:47.079401 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-854a1ab3-43ed-4c75-a401-e12b92905498 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:47.213024 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-854a1ab3-43ed-4c75-a401-e12b92905498 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:47.225361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-854a1ab3-43ed-4c75-a401-e12b92905498 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1358 microversion: 2.1 time: 0.159544 Aug 18 14:30:47.226234 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 335/672] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:47 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:47.534006 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-11fe67ca-417a-49bb-98c9-67bf118bd2bc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:47.534942 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-11fe67ca-417a-49bb-98c9-67bf118bd2bc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:47.543848 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11fe67ca-417a-49bb-98c9-67bf118bd2bc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:47.544952 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11fe67ca-417a-49bb-98c9-67bf118bd2bc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:47.545796 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11fe67ca-417a-49bb-98c9-67bf118bd2bc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:47.547177 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11fe67ca-417a-49bb-98c9-67bf118bd2bc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:47.548111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11fe67ca-417a-49bb-98c9-67bf118bd2bc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:47.549235 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11fe67ca-417a-49bb-98c9-67bf118bd2bc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:47.861094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0d4fe435-b748-485d-80b6-1a43f1e3575f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:47.861632 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0d4fe435-b748-485d-80b6-1a43f1e3575f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:47.867707 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d4fe435-b748-485d-80b6-1a43f1e3575f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:47.868198 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d4fe435-b748-485d-80b6-1a43f1e3575f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:47.868641 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d4fe435-b748-485d-80b6-1a43f1e3575f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:47.869353 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d4fe435-b748-485d-80b6-1a43f1e3575f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:47.870014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d4fe435-b748-485d-80b6-1a43f1e3575f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:47.870517 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d4fe435-b748-485d-80b6-1a43f1e3575f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:47.936645 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0d4fe435-b748-485d-80b6-1a43f1e3575f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:47.945314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0d4fe435-b748-485d-80b6-1a43f1e3575f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1296 microversion: 2.1 time: 0.088123 Aug 18 14:30:47.945889 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 336/673] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:47 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:30:48.002984 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-11fe67ca-417a-49bb-98c9-67bf118bd2bc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:48.010732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-11fe67ca-417a-49bb-98c9-67bf118bd2bc tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1366 microversion: 2.1 time: 0.481761 Aug 18 14:30:48.011302 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 338/674] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:47 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:48.247862 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-32351718-4993-4b75-a3c9-30ec2f34dd07 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:48.249271 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-32351718-4993-4b75-a3c9-30ec2f34dd07 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:48.260022 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32351718-4993-4b75-a3c9-30ec2f34dd07 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:48.260622 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32351718-4993-4b75-a3c9-30ec2f34dd07 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:48.261221 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32351718-4993-4b75-a3c9-30ec2f34dd07 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:48.261998 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32351718-4993-4b75-a3c9-30ec2f34dd07 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:48.262818 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32351718-4993-4b75-a3c9-30ec2f34dd07 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:48.263644 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32351718-4993-4b75-a3c9-30ec2f34dd07 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:48.402243 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-32351718-4993-4b75-a3c9-30ec2f34dd07 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:48.411192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-32351718-4993-4b75-a3c9-30ec2f34dd07 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1358 microversion: 2.1 time: 0.167649 Aug 18 14:30:48.411902 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 337/675] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:48 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:48.967342 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9f867bf5-5662-47eb-8584-4ee8eff22162 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:48.967981 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9f867bf5-5662-47eb-8584-4ee8eff22162 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:48.974792 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f867bf5-5662-47eb-8584-4ee8eff22162 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:48.975272 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f867bf5-5662-47eb-8584-4ee8eff22162 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:48.975746 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f867bf5-5662-47eb-8584-4ee8eff22162 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:48.976426 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f867bf5-5662-47eb-8584-4ee8eff22162 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:48.976874 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f867bf5-5662-47eb-8584-4ee8eff22162 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:48.977292 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f867bf5-5662-47eb-8584-4ee8eff22162 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:49.033102 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-564bbb5f-fdd0-4661-8216-0c5ad74b8970 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:49.033727 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-564bbb5f-fdd0-4661-8216-0c5ad74b8970 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:49.039742 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-564bbb5f-fdd0-4661-8216-0c5ad74b8970 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:49.040230 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-564bbb5f-fdd0-4661-8216-0c5ad74b8970 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:49.040668 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-564bbb5f-fdd0-4661-8216-0c5ad74b8970 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:49.041367 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-564bbb5f-fdd0-4661-8216-0c5ad74b8970 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:49.041823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-564bbb5f-fdd0-4661-8216-0c5ad74b8970 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:49.042250 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-564bbb5f-fdd0-4661-8216-0c5ad74b8970 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:49.181716 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-564bbb5f-fdd0-4661-8216-0c5ad74b8970 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:49.188088 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:49.194543 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-564bbb5f-fdd0-4661-8216-0c5ad74b8970 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1366 microversion: 2.1 time: 0.166085 Aug 18 14:30:49.195319 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 338/676] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:49 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:30:49.198230 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9f867bf5-5662-47eb-8584-4ee8eff22162 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:49.208153 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9f867bf5-5662-47eb-8584-4ee8eff22162 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1364 microversion: 2.1 time: 0.244905 Aug 18 14:30:49.208732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 339/677] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:48 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:49.432006 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a93a12a8-e6ce-4dd2-941d-619d2294b35b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:49.432556 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a93a12a8-e6ce-4dd2-941d-619d2294b35b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:49.434981 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:49.440259 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a93a12a8-e6ce-4dd2-941d-619d2294b35b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:49.440748 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a93a12a8-e6ce-4dd2-941d-619d2294b35b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:49.441194 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a93a12a8-e6ce-4dd2-941d-619d2294b35b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:49.441896 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a93a12a8-e6ce-4dd2-941d-619d2294b35b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:49.442348 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a93a12a8-e6ce-4dd2-941d-619d2294b35b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:49.442776 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a93a12a8-e6ce-4dd2-941d-619d2294b35b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:49.492043 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-603f135b-26ed-416c-9a3c-a4c4f33899c6 req-3598b637-dac0-41c4-a677-063b10e73e93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e298a2-722b-4340-a4cc-7b5cf8596c17", "tag": "e791bcac-2cb5-453d-a4bc-49e1afe3ebc8"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:49.518197 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-603f135b-26ed-416c-9a3c-a4c4f33899c6 req-3598b637-dac0-41c4-a677-063b10e73e93 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:49.518685 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-603f135b-26ed-416c-9a3c-a4c4f33899c6 req-3598b637-dac0-41c4-a677-063b10e73e93 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:49.519123 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-603f135b-26ed-416c-9a3c-a4c4f33899c6 req-3598b637-dac0-41c4-a677-063b10e73e93 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:49.531986 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-603f135b-26ed-416c-9a3c-a4c4f33899c6 req-3598b637-dac0-41c4-a677-063b10e73e93 service nova] Creating event network-changed:e791bcac-2cb5-453d-a4bc-49e1afe3ebc8 for instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 on hv-cinder-85220 Aug 18 14:30:49.537351 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-603f135b-26ed-416c-9a3c-a4c4f33899c6 req-3598b637-dac0-41c4-a677-063b10e73e93 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049693 Aug 18 14:30:49.538166 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 340/678] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:49.607469 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a93a12a8-e6ce-4dd2-941d-619d2294b35b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:49.616224 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a93a12a8-e6ce-4dd2-941d-619d2294b35b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1549 microversion: 2.1 time: 0.188175 Aug 18 14:30:49.616796 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 339/679] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:49 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1549 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:49.637078 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e37b93a9-e74f-43e5-8742-18b18656683d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:49.637779 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e37b93a9-e74f-43e5-8742-18b18656683d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:49.644055 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e37b93a9-e74f-43e5-8742-18b18656683d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:49.644546 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e37b93a9-e74f-43e5-8742-18b18656683d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:49.644979 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e37b93a9-e74f-43e5-8742-18b18656683d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:49.645665 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e37b93a9-e74f-43e5-8742-18b18656683d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:49.646118 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e37b93a9-e74f-43e5-8742-18b18656683d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:49.646541 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e37b93a9-e74f-43e5-8742-18b18656683d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:49.864714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e37b93a9-e74f-43e5-8742-18b18656683d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:49.873970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e37b93a9-e74f-43e5-8742-18b18656683d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1549 microversion: 2.1 time: 0.241094 Aug 18 14:30:49.874817 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 341/680] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:49 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1549 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:30:49.894370 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ffb61531-88f5-41f2-9812-7d6189d4ea29 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:49.899118 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ffb61531-88f5-41f2-9812-7d6189d4ea29 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:49.899962 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ffb61531-88f5-41f2-9812-7d6189d4ea29 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Searching by: {'deleted': False, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e'} {{(pid=120539) get_all /opt/stack/nova/nova/compute/api.py:3007}} Aug 18 14:30:49.907118 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb61531-88f5-41f2-9812-7d6189d4ea29 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:49.907675 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb61531-88f5-41f2-9812-7d6189d4ea29 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:49.908118 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb61531-88f5-41f2-9812-7d6189d4ea29 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:49.908849 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb61531-88f5-41f2-9812-7d6189d4ea29 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:49.909307 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb61531-88f5-41f2-9812-7d6189d4ea29 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:49.909738 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb61531-88f5-41f2-9812-7d6189d4ea29 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:50.001008 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.multi_cell_list [None req-ffb61531-88f5-41f2-9812-7d6189d4ea29 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 14:30:50.098608 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ffb61531-88f5-41f2-9812-7d6189d4ea29 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.207969 Aug 18 14:30:50.099188 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 340/681] 10.222.0.39 () {58 vars in 1125 bytes} [Thu Aug 18 14:30:49 2022] GET /compute/v2.1/servers => generated 343 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:50.110192 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9141ebf8-c527-402f-a73b-bb550cf8515f tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:50.111606 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9141ebf8-c527-402f-a73b-bb550cf8515f tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:50.118157 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9141ebf8-c527-402f-a73b-bb550cf8515f tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:50.118707 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9141ebf8-c527-402f-a73b-bb550cf8515f tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:50.119074 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9141ebf8-c527-402f-a73b-bb550cf8515f tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:50.119798 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9141ebf8-c527-402f-a73b-bb550cf8515f tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:50.120327 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9141ebf8-c527-402f-a73b-bb550cf8515f tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:50.120954 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9141ebf8-c527-402f-a73b-bb550cf8515f tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:50.214741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-48ae0819-11bc-4281-b135-a3cb23f15145 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:50.215505 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-48ae0819-11bc-4281-b135-a3cb23f15145 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:50.222381 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48ae0819-11bc-4281-b135-a3cb23f15145 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:50.224260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48ae0819-11bc-4281-b135-a3cb23f15145 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:50.224260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48ae0819-11bc-4281-b135-a3cb23f15145 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:50.224260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48ae0819-11bc-4281-b135-a3cb23f15145 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:50.224987 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48ae0819-11bc-4281-b135-a3cb23f15145 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:50.225533 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48ae0819-11bc-4281-b135-a3cb23f15145 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:50.255251 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9141ebf8-c527-402f-a73b-bb550cf8515f tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:50.272453 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9141ebf8-c527-402f-a73b-bb550cf8515f tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1549 microversion: 2.1 time: 0.165914 Aug 18 14:30:50.273231 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 342/682] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:50 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:50.277615 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-47e0e9bb-85d7-4609-ae69-8b8ff107950b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:50.278213 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-47e0e9bb-85d7-4609-ae69-8b8ff107950b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:50.285333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47e0e9bb-85d7-4609-ae69-8b8ff107950b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:50.285819 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47e0e9bb-85d7-4609-ae69-8b8ff107950b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:50.286248 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47e0e9bb-85d7-4609-ae69-8b8ff107950b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:50.286930 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47e0e9bb-85d7-4609-ae69-8b8ff107950b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:50.287725 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47e0e9bb-85d7-4609-ae69-8b8ff107950b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:50.289866 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47e0e9bb-85d7-4609-ae69-8b8ff107950b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:50.388717 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-48ae0819-11bc-4281-b135-a3cb23f15145 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:50.397239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-48ae0819-11bc-4281-b135-a3cb23f15145 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1366 microversion: 2.1 time: 0.186390 Aug 18 14:30:50.397911 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 341/683] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:50 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:30:50.432432 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-47e0e9bb-85d7-4609-ae69-8b8ff107950b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:50.440258 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-47e0e9bb-85d7-4609-ae69-8b8ff107950b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1364 microversion: 2.1 time: 0.166263 Aug 18 14:30:50.440815 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 343/684] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:50 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:51.419628 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3ad6e712-a393-439c-90f5-c0a4bb6557ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:51.420246 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3ad6e712-a393-439c-90f5-c0a4bb6557ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:51.426717 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ad6e712-a393-439c-90f5-c0a4bb6557ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:51.427140 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ad6e712-a393-439c-90f5-c0a4bb6557ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:51.427611 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ad6e712-a393-439c-90f5-c0a4bb6557ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:51.428293 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ad6e712-a393-439c-90f5-c0a4bb6557ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:51.428742 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ad6e712-a393-439c-90f5-c0a4bb6557ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:51.429166 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ad6e712-a393-439c-90f5-c0a4bb6557ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:51.461109 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-efa2954e-0c3c-461d-9b95-bf6de7c39366 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:51.461717 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-efa2954e-0c3c-461d-9b95-bf6de7c39366 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:51.468406 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efa2954e-0c3c-461d-9b95-bf6de7c39366 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:51.468889 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efa2954e-0c3c-461d-9b95-bf6de7c39366 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:51.469319 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efa2954e-0c3c-461d-9b95-bf6de7c39366 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:51.470568 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efa2954e-0c3c-461d-9b95-bf6de7c39366 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:51.471037 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efa2954e-0c3c-461d-9b95-bf6de7c39366 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:51.471481 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efa2954e-0c3c-461d-9b95-bf6de7c39366 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:51.562334 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3ad6e712-a393-439c-90f5-c0a4bb6557ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:51.570993 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3ad6e712-a393-439c-90f5-c0a4bb6557ae tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1366 microversion: 2.1 time: 0.155196 Aug 18 14:30:51.571619 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 342/685] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:51 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:51.604326 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-efa2954e-0c3c-461d-9b95-bf6de7c39366 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:51.612766 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-efa2954e-0c3c-461d-9b95-bf6de7c39366 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1364 microversion: 2.1 time: 0.155382 Aug 18 14:30:51.613328 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 344/686] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:51 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:30:51.831937 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f79458b3-0d59-4bb4-a708-eb6bd620fb8c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11a75190-bf96-42df-bce4-c36f6a832d63"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:51.834226 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-44364a7d-37bf-48b4-8fc1-590b82cd2784 req-8008b308-f9c5-4338-8094-13028b49ed28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d8b41d-49fe-4ffd-9896-33f4a20a437b", "name": "network-vif-plugged", "status": "completed", "tag": "e29f52c7-443d-4909-adc8-b988297386bb"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:51.834599 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f79458b3-0d59-4bb4-a708-eb6bd620fb8c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:51.840910 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f79458b3-0d59-4bb4-a708-eb6bd620fb8c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:51.842017 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f79458b3-0d59-4bb4-a708-eb6bd620fb8c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:51.842686 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f79458b3-0d59-4bb4-a708-eb6bd620fb8c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:51.843715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f79458b3-0d59-4bb4-a708-eb6bd620fb8c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:51.844121 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-44364a7d-37bf-48b4-8fc1-590b82cd2784 req-8008b308-f9c5-4338-8094-13028b49ed28 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:51.844468 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f79458b3-0d59-4bb4-a708-eb6bd620fb8c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:51.844602 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-44364a7d-37bf-48b4-8fc1-590b82cd2784 req-8008b308-f9c5-4338-8094-13028b49ed28 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:51.845568 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-44364a7d-37bf-48b4-8fc1-590b82cd2784 req-8008b308-f9c5-4338-8094-13028b49ed28 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:51.845694 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f79458b3-0d59-4bb4-a708-eb6bd620fb8c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:51.852391 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:51.861368 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-44364a7d-37bf-48b4-8fc1-590b82cd2784 req-8008b308-f9c5-4338-8094-13028b49ed28 service nova] Creating event network-vif-plugged:e29f52c7-443d-4909-adc8-b988297386bb for instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b on hv-cinder-85220 Aug 18 14:30:51.866279 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-44364a7d-37bf-48b4-8fc1-590b82cd2784 req-8008b308-f9c5-4338-8094-13028b49ed28 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035864 Aug 18 14:30:51.866938 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 345/687] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:30:52.109487 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f79458b3-0d59-4bb4-a708-eb6bd620fb8c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "POST /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282195 Aug 18 14:30:52.110135 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 343/688] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:30:51 2022] POST /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:52.591675 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cc6f6784-ffb5-4cbb-92b1-3e826cab2f8a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:52.592326 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cc6f6784-ffb5-4cbb-92b1-3e826cab2f8a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:52.600055 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc6f6784-ffb5-4cbb-92b1-3e826cab2f8a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:52.600559 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc6f6784-ffb5-4cbb-92b1-3e826cab2f8a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:52.601029 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc6f6784-ffb5-4cbb-92b1-3e826cab2f8a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:52.601707 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc6f6784-ffb5-4cbb-92b1-3e826cab2f8a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:52.602157 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc6f6784-ffb5-4cbb-92b1-3e826cab2f8a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:52.602574 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc6f6784-ffb5-4cbb-92b1-3e826cab2f8a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:52.635514 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6bbacbab-07e1-4d97-909f-c0e422ddb340 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:52.636210 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6bbacbab-07e1-4d97-909f-c0e422ddb340 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:52.642809 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbacbab-07e1-4d97-909f-c0e422ddb340 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:52.643297 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbacbab-07e1-4d97-909f-c0e422ddb340 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:52.643794 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbacbab-07e1-4d97-909f-c0e422ddb340 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:52.644756 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbacbab-07e1-4d97-909f-c0e422ddb340 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:52.645202 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbacbab-07e1-4d97-909f-c0e422ddb340 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:52.645852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbacbab-07e1-4d97-909f-c0e422ddb340 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:52.739124 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cc6f6784-ffb5-4cbb-92b1-3e826cab2f8a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:52.746918 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cc6f6784-ffb5-4cbb-92b1-3e826cab2f8a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1366 microversion: 2.1 time: 0.159778 Aug 18 14:30:52.747572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 346/689] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:52 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:52.786102 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6bbacbab-07e1-4d97-909f-c0e422ddb340 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:52.793719 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6bbacbab-07e1-4d97-909f-c0e422ddb340 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1364 microversion: 2.1 time: 0.163644 Aug 18 14:30:52.794360 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 344/690] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:52 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:53.768632 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d7618eea-5905-4a17-8027-64258ff4175f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:53.769239 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d7618eea-5905-4a17-8027-64258ff4175f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:53.771649 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:53.776860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7618eea-5905-4a17-8027-64258ff4175f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:53.777337 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7618eea-5905-4a17-8027-64258ff4175f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:53.777768 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7618eea-5905-4a17-8027-64258ff4175f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:53.778455 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7618eea-5905-4a17-8027-64258ff4175f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:53.778907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7618eea-5905-4a17-8027-64258ff4175f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:53.779326 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7618eea-5905-4a17-8027-64258ff4175f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:53.815498 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4293e8b0-897a-4310-beba-3317a6b0e47a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:53.816516 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4293e8b0-897a-4310-beba-3317a6b0e47a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:53.823124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4293e8b0-897a-4310-beba-3317a6b0e47a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:53.823760 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4293e8b0-897a-4310-beba-3317a6b0e47a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:53.824421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4293e8b0-897a-4310-beba-3317a6b0e47a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:53.825222 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4293e8b0-897a-4310-beba-3317a6b0e47a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:53.825774 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4293e8b0-897a-4310-beba-3317a6b0e47a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:53.826296 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4293e8b0-897a-4310-beba-3317a6b0e47a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:53.919160 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d7618eea-5905-4a17-8027-64258ff4175f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:53.928011 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d7618eea-5905-4a17-8027-64258ff4175f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1556 microversion: 2.1 time: 0.163407 Aug 18 14:30:53.929197 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 347/691] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:53 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:53.955273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a67f9c39-76e8-4c66-98d1-9f5e1132ab91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:53.955795 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a67f9c39-76e8-4c66-98d1-9f5e1132ab91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:53.961921 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a67f9c39-76e8-4c66-98d1-9f5e1132ab91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:53.962411 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a67f9c39-76e8-4c66-98d1-9f5e1132ab91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:53.962854 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a67f9c39-76e8-4c66-98d1-9f5e1132ab91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:53.963576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a67f9c39-76e8-4c66-98d1-9f5e1132ab91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:53.964202 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a67f9c39-76e8-4c66-98d1-9f5e1132ab91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:53.964633 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a67f9c39-76e8-4c66-98d1-9f5e1132ab91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:53.971034 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4293e8b0-897a-4310-beba-3317a6b0e47a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:53.979178 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4293e8b0-897a-4310-beba-3317a6b0e47a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1364 microversion: 2.1 time: 0.168446 Aug 18 14:30:53.979784 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 345/692] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:53 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:30:54.045058 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a67f9c39-76e8-4c66-98d1-9f5e1132ab91 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100352 Aug 18 14:30:54.045655 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 348/693] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Aug 18 14:30:53 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:55.003990 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8dc6c52e-aeb8-40f1-a833-cf8605004cb8 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:55.004641 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8dc6c52e-aeb8-40f1-a833-cf8605004cb8 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:55.010639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8dc6c52e-aeb8-40f1-a833-cf8605004cb8 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:55.011299 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8dc6c52e-aeb8-40f1-a833-cf8605004cb8 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:55.011926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8dc6c52e-aeb8-40f1-a833-cf8605004cb8 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:55.012666 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8dc6c52e-aeb8-40f1-a833-cf8605004cb8 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:55.013126 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8dc6c52e-aeb8-40f1-a833-cf8605004cb8 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:55.013552 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8dc6c52e-aeb8-40f1-a833-cf8605004cb8 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:55.051303 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-d09d6107-42da-46eb-983f-a5e1de510c70 req-a667bb1f-8736-4634-a0f8-279d2b8171ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86d8b41d-49fe-4ffd-9896-33f4a20a437b", "tag": "e29f52c7-443d-4909-adc8-b988297386bb"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:55.063599 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d09d6107-42da-46eb-983f-a5e1de510c70 req-a667bb1f-8736-4634-a0f8-279d2b8171ed service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:55.064078 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d09d6107-42da-46eb-983f-a5e1de510c70 req-a667bb1f-8736-4634-a0f8-279d2b8171ed service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:55.065407 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d09d6107-42da-46eb-983f-a5e1de510c70 req-a667bb1f-8736-4634-a0f8-279d2b8171ed service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:55.077909 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-d09d6107-42da-46eb-983f-a5e1de510c70 req-a667bb1f-8736-4634-a0f8-279d2b8171ed service nova] Creating event network-changed:e29f52c7-443d-4909-adc8-b988297386bb for instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b on hv-cinder-85220 Aug 18 14:30:55.083227 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-d09d6107-42da-46eb-983f-a5e1de510c70 req-a667bb1f-8736-4634-a0f8-279d2b8171ed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100398 Aug 18 14:30:55.083661 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 346/694] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:55.190198 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8dc6c52e-aeb8-40f1-a833-cf8605004cb8 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:55.199594 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8dc6c52e-aeb8-40f1-a833-cf8605004cb8 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1364 microversion: 2.1 time: 0.201878 Aug 18 14:30:55.200177 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 349/695] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:54 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:30:55.973532 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-38058fae-5752-4fc6-ac0a-aba78d17418f req-839ee9bc-0e0a-465d-a518-cdf6b73bb21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e298a2-722b-4340-a4cc-7b5cf8596c17", "name": "network-vif-plugged", "status": "completed", "tag": "e791bcac-2cb5-453d-a4bc-49e1afe3ebc8"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:55.979145 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=12 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:55.985489 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-38058fae-5752-4fc6-ac0a-aba78d17418f req-839ee9bc-0e0a-465d-a518-cdf6b73bb21b service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:55.986399 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-38058fae-5752-4fc6-ac0a-aba78d17418f req-839ee9bc-0e0a-465d-a518-cdf6b73bb21b service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:55.986560 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-38058fae-5752-4fc6-ac0a-aba78d17418f req-839ee9bc-0e0a-465d-a518-cdf6b73bb21b service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:56.002190 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-38058fae-5752-4fc6-ac0a-aba78d17418f req-839ee9bc-0e0a-465d-a518-cdf6b73bb21b service nova] Creating event network-vif-plugged:e791bcac-2cb5-453d-a4bc-49e1afe3ebc8 for instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 on hv-cinder-85220 Aug 18 14:30:56.008789 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-38058fae-5752-4fc6-ac0a-aba78d17418f req-839ee9bc-0e0a-465d-a518-cdf6b73bb21b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039562 Aug 18 14:30:56.009991 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 347/696] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:56.221063 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7917b10e-6764-4bb1-a1d7-bc33e2840d48 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:56.222090 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7917b10e-6764-4bb1-a1d7-bc33e2840d48 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:56.225485 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=18 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:30:56.230911 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7917b10e-6764-4bb1-a1d7-bc33e2840d48 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:56.232219 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7917b10e-6764-4bb1-a1d7-bc33e2840d48 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:56.239543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7917b10e-6764-4bb1-a1d7-bc33e2840d48 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:56.240374 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7917b10e-6764-4bb1-a1d7-bc33e2840d48 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:56.240923 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7917b10e-6764-4bb1-a1d7-bc33e2840d48 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:56.241467 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7917b10e-6764-4bb1-a1d7-bc33e2840d48 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:56.378055 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7917b10e-6764-4bb1-a1d7-bc33e2840d48 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:56.385865 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7917b10e-6764-4bb1-a1d7-bc33e2840d48 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1364 microversion: 2.1 time: 0.168759 Aug 18 14:30:56.387293 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 350/697] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:56 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:57.406300 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4c700e85-2990-4a16-a0b8-f63aff22c29e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:57.407006 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4c700e85-2990-4a16-a0b8-f63aff22c29e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:57.414428 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c700e85-2990-4a16-a0b8-f63aff22c29e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:57.415227 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c700e85-2990-4a16-a0b8-f63aff22c29e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:57.415697 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c700e85-2990-4a16-a0b8-f63aff22c29e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:57.416475 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c700e85-2990-4a16-a0b8-f63aff22c29e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:57.416936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c700e85-2990-4a16-a0b8-f63aff22c29e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:57.417365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c700e85-2990-4a16-a0b8-f63aff22c29e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:57.551894 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4c700e85-2990-4a16-a0b8-f63aff22c29e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:57.559504 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4c700e85-2990-4a16-a0b8-f63aff22c29e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1364 microversion: 2.1 time: 0.157480 Aug 18 14:30:57.560067 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 348/698] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:57 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:58.581009 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-20f93ba6-2e5a-4b5a-9e72-720b570be108 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:58.581623 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-20f93ba6-2e5a-4b5a-9e72-720b570be108 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:58.588067 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20f93ba6-2e5a-4b5a-9e72-720b570be108 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:58.588545 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20f93ba6-2e5a-4b5a-9e72-720b570be108 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:58.588979 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20f93ba6-2e5a-4b5a-9e72-720b570be108 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:58.589664 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20f93ba6-2e5a-4b5a-9e72-720b570be108 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:58.590114 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20f93ba6-2e5a-4b5a-9e72-720b570be108 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:58.590538 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20f93ba6-2e5a-4b5a-9e72-720b570be108 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:58.725104 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-20f93ba6-2e5a-4b5a-9e72-720b570be108 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:58.733858 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-20f93ba6-2e5a-4b5a-9e72-720b570be108 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1549 microversion: 2.1 time: 0.157343 Aug 18 14:30:58.734448 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 351/699] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:58 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:30:58.755086 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c38dcf0e-0030-4d60-a28a-b5c928911952 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:58.755656 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c38dcf0e-0030-4d60-a28a-b5c928911952 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:58.761653 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c38dcf0e-0030-4d60-a28a-b5c928911952 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:58.762138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c38dcf0e-0030-4d60-a28a-b5c928911952 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:58.762573 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c38dcf0e-0030-4d60-a28a-b5c928911952 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:58.763266 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c38dcf0e-0030-4d60-a28a-b5c928911952 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:58.763750 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c38dcf0e-0030-4d60-a28a-b5c928911952 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:58.764179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c38dcf0e-0030-4d60-a28a-b5c928911952 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:58.845891 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c38dcf0e-0030-4d60-a28a-b5c928911952 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095213 Aug 18 14:30:58.846509 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 349/700] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Aug 18 14:30:58 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:59.701430 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-582fa450-75b7-4642-b218-0253d178054d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:30:59.702047 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-582fa450-75b7-4642-b218-0253d178054d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:30:59.708960 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-582fa450-75b7-4642-b218-0253d178054d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:59.709444 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-582fa450-75b7-4642-b218-0253d178054d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:59.709884 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-582fa450-75b7-4642-b218-0253d178054d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:59.710569 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-582fa450-75b7-4642-b218-0253d178054d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:59.711021 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-582fa450-75b7-4642-b218-0253d178054d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:59.711483 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-582fa450-75b7-4642-b218-0253d178054d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:59.786136 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-28727887-c145-43b7-929d-5fd2771e461e req-6dcbc45d-f338-4d15-b74b-f6c35cc12260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e298a2-722b-4340-a4cc-7b5cf8596c17", "tag": "e791bcac-2cb5-453d-a4bc-49e1afe3ebc8"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:30:59.795326 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-28727887-c145-43b7-929d-5fd2771e461e req-6dcbc45d-f338-4d15-b74b-f6c35cc12260 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:30:59.796055 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-28727887-c145-43b7-929d-5fd2771e461e req-6dcbc45d-f338-4d15-b74b-f6c35cc12260 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:30:59.796484 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-28727887-c145-43b7-929d-5fd2771e461e req-6dcbc45d-f338-4d15-b74b-f6c35cc12260 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:30:59.808285 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-28727887-c145-43b7-929d-5fd2771e461e req-6dcbc45d-f338-4d15-b74b-f6c35cc12260 service nova] Creating event network-changed:e791bcac-2cb5-453d-a4bc-49e1afe3ebc8 for instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 on hv-cinder-85220 Aug 18 14:30:59.813310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-28727887-c145-43b7-929d-5fd2771e461e req-6dcbc45d-f338-4d15-b74b-f6c35cc12260 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032259 Aug 18 14:30:59.814536 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 350/701] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:30:59.888093 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-582fa450-75b7-4642-b218-0253d178054d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:30:59.897751 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-582fa450-75b7-4642-b218-0253d178054d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1595 microversion: 2.1 time: 0.200021 Aug 18 14:30:59.898330 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 352/702] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:30:59 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1595 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:01.903028 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:31:01.908155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-6b6913fb-02ee-49f1-8a67-bbfd0faef357 req-924cecef-b599-4013-be55-d2b3e6fa7a1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f291a369-1330-40f8-b4fc-d6af6b3afa1b", "tag": "6a55ee51-1001-4a61-a93a-c6e99dbaa47a"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:31:01.926974 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6b6913fb-02ee-49f1-8a67-bbfd0faef357 req-924cecef-b599-4013-be55-d2b3e6fa7a1d service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:01.927478 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6b6913fb-02ee-49f1-8a67-bbfd0faef357 req-924cecef-b599-4013-be55-d2b3e6fa7a1d service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:01.927908 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6b6913fb-02ee-49f1-8a67-bbfd0faef357 req-924cecef-b599-4013-be55-d2b3e6fa7a1d service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:01.940712 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-6b6913fb-02ee-49f1-8a67-bbfd0faef357 req-924cecef-b599-4013-be55-d2b3e6fa7a1d service nova] Creating event network-changed:6a55ee51-1001-4a61-a93a-c6e99dbaa47a for instance f291a369-1330-40f8-b4fc-d6af6b3afa1b on hv-cinder-85220 Aug 18 14:31:01.945646 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-6b6913fb-02ee-49f1-8a67-bbfd0faef357 req-924cecef-b599-4013-be55-d2b3e6fa7a1d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043785 Aug 18 14:31:01.948981 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 351/703] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:31:02.162481 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-213ae550-57a8-4b6d-ada4-9cfd215c7930 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:02.178300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-213ae550-57a8-4b6d-ada4-9cfd215c7930 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:02.184528 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-213ae550-57a8-4b6d-ada4-9cfd215c7930 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:02.185026 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-213ae550-57a8-4b6d-ada4-9cfd215c7930 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:02.189105 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-213ae550-57a8-4b6d-ada4-9cfd215c7930 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:02.191646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-213ae550-57a8-4b6d-ada4-9cfd215c7930 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:02.197908 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-213ae550-57a8-4b6d-ada4-9cfd215c7930 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:02.197908 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-213ae550-57a8-4b6d-ada4-9cfd215c7930 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:02.228141 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-213ae550-57a8-4b6d-ada4-9cfd215c7930 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/ips" status: 200 len: 151 microversion: 2.20 time: 0.075919 Aug 18 14:31:02.228945 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 353/704] 10.222.0.39 () {60 vars in 1289 bytes} [Thu Aug 18 14:31:02 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/ips => generated 151 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 14:31:03.170954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-871767c6-b969-4d6f-ab8f-5a544ba00198 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1047992206"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:31:03.171638 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-871767c6-b969-4d6f-ab8f-5a544ba00198 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:03.179269 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871767c6-b969-4d6f-ab8f-5a544ba00198 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:03.179840 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871767c6-b969-4d6f-ab8f-5a544ba00198 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:03.180308 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871767c6-b969-4d6f-ab8f-5a544ba00198 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:03.181013 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871767c6-b969-4d6f-ab8f-5a544ba00198 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:03.181471 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871767c6-b969-4d6f-ab8f-5a544ba00198 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:03.181902 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871767c6-b969-4d6f-ab8f-5a544ba00198 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:03.310900 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.network.security_group_api [None req-871767c6-b969-4d6f-ab8f-5a544ba00198 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Adding security group 95b7d166-082c-4104-adb2-05b5df10f9d5 to port 6a55ee51-1001-4a61-a93a-c6e99dbaa47a Aug 18 14:31:03.633879 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-871767c6-b969-4d6f-ab8f-5a544ba00198 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "POST /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/action" status: 202 len: 0 microversion: 2.1 time: 0.467573 Aug 18 14:31:03.637617 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 352/705] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:31:03 2022] POST /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:31:03.644430 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ec6abb1d-46c4-47f6-870b-abb212a4f20e tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:03.645126 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ec6abb1d-46c4-47f6-870b-abb212a4f20e tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:03.651874 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec6abb1d-46c4-47f6-870b-abb212a4f20e tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:03.652436 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec6abb1d-46c4-47f6-870b-abb212a4f20e tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:03.652968 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec6abb1d-46c4-47f6-870b-abb212a4f20e tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:03.653755 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec6abb1d-46c4-47f6-870b-abb212a4f20e tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:03.654419 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec6abb1d-46c4-47f6-870b-abb212a4f20e tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:03.654884 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec6abb1d-46c4-47f6-870b-abb212a4f20e tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:03.803192 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ec6abb1d-46c4-47f6-870b-abb212a4f20e tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:03.811653 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ec6abb1d-46c4-47f6-870b-abb212a4f20e tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1761 microversion: 2.1 time: 0.172393 Aug 18 14:31:03.812215 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 354/706] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:03 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1761 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:31:03.961030 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-b87c399a-9134-4b2c-8d84-5380907a71cf req-669fc251-9c11-4980-a4b3-c61c87f0d183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f291a369-1330-40f8-b4fc-d6af6b3afa1b", "tag": "6a55ee51-1001-4a61-a93a-c6e99dbaa47a"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:31:03.971451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b87c399a-9134-4b2c-8d84-5380907a71cf req-669fc251-9c11-4980-a4b3-c61c87f0d183 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:03.971939 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b87c399a-9134-4b2c-8d84-5380907a71cf req-669fc251-9c11-4980-a4b3-c61c87f0d183 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:03.972378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b87c399a-9134-4b2c-8d84-5380907a71cf req-669fc251-9c11-4980-a4b3-c61c87f0d183 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:03.983271 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-b87c399a-9134-4b2c-8d84-5380907a71cf req-669fc251-9c11-4980-a4b3-c61c87f0d183 service nova] Creating event network-changed:6a55ee51-1001-4a61-a93a-c6e99dbaa47a for instance f291a369-1330-40f8-b4fc-d6af6b3afa1b on hv-cinder-85220 Aug 18 14:31:03.988147 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-b87c399a-9134-4b2c-8d84-5380907a71cf req-669fc251-9c11-4980-a4b3-c61c87f0d183 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030810 Aug 18 14:31:03.988742 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 353/707] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:31:04.603700 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b9e93cbe-023e-459c-8485-89c2df69bedd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:31:04.604239 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b9e93cbe-023e-459c-8485-89c2df69bedd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:04.610282 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9e93cbe-023e-459c-8485-89c2df69bedd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:04.610858 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9e93cbe-023e-459c-8485-89c2df69bedd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:04.611337 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9e93cbe-023e-459c-8485-89c2df69bedd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:04.612086 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9e93cbe-023e-459c-8485-89c2df69bedd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:04.612541 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9e93cbe-023e-459c-8485-89c2df69bedd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:04.612966 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9e93cbe-023e-459c-8485-89c2df69bedd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:04.635633 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-b9e93cbe-023e-459c-8485-89c2df69bedd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lazy-loading 'flavor' on Instance uuid 910c9fdb-a6d3-4e60-843e-9e65d037ea71 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:31:04.808449 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b9e93cbe-023e-459c-8485-89c2df69bedd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "POST /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/action" status: 202 len: 0 microversion: 2.20 time: 0.208546 Aug 18 14:31:04.809043 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 355/708] 10.222.0.39 () {62 vars in 1319 bytes} [Thu Aug 18 14:31:04 2022] POST /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:31:04.818729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cd8a5550-5685-4c2d-bd2f-18fb89850f04 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:04.819624 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cd8a5550-5685-4c2d-bd2f-18fb89850f04 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:04.825729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd8a5550-5685-4c2d-bd2f-18fb89850f04 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:04.826274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd8a5550-5685-4c2d-bd2f-18fb89850f04 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:04.826714 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd8a5550-5685-4c2d-bd2f-18fb89850f04 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:04.827542 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd8a5550-5685-4c2d-bd2f-18fb89850f04 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:04.828001 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd8a5550-5685-4c2d-bd2f-18fb89850f04 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:04.828428 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd8a5550-5685-4c2d-bd2f-18fb89850f04 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:04.967578 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cd8a5550-5685-4c2d-bd2f-18fb89850f04 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:04.975730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cd8a5550-5685-4c2d-bd2f-18fb89850f04 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:04.977224 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cd8a5550-5685-4c2d-bd2f-18fb89850f04 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:04.978371 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cd8a5550-5685-4c2d-bd2f-18fb89850f04 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.165015 Aug 18 14:31:04.978931 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 354/709] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:04 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:06.003723 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b2fad46b-dc67-4563-aebd-b3f3446999d7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:06.004413 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b2fad46b-dc67-4563-aebd-b3f3446999d7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:06.010786 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2fad46b-dc67-4563-aebd-b3f3446999d7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:06.011275 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2fad46b-dc67-4563-aebd-b3f3446999d7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:06.011736 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2fad46b-dc67-4563-aebd-b3f3446999d7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:06.012431 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2fad46b-dc67-4563-aebd-b3f3446999d7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:06.012918 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2fad46b-dc67-4563-aebd-b3f3446999d7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:06.013373 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2fad46b-dc67-4563-aebd-b3f3446999d7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:06.141412 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b2fad46b-dc67-4563-aebd-b3f3446999d7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:06.150129 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b2fad46b-dc67-4563-aebd-b3f3446999d7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:06.151638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b2fad46b-dc67-4563-aebd-b3f3446999d7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:06.152786 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b2fad46b-dc67-4563-aebd-b3f3446999d7 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.154447 Aug 18 14:31:06.153340 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 356/710] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:05 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:07.176250 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-66a2bd9e-f961-4a33-8bcd-372101ba8dea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:07.176793 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-66a2bd9e-f961-4a33-8bcd-372101ba8dea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:07.183235 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-66a2bd9e-f961-4a33-8bcd-372101ba8dea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:07.183755 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-66a2bd9e-f961-4a33-8bcd-372101ba8dea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:07.184191 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-66a2bd9e-f961-4a33-8bcd-372101ba8dea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:07.184884 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-66a2bd9e-f961-4a33-8bcd-372101ba8dea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:07.185324 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-66a2bd9e-f961-4a33-8bcd-372101ba8dea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:07.185750 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-66a2bd9e-f961-4a33-8bcd-372101ba8dea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:07.317173 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-66a2bd9e-f961-4a33-8bcd-372101ba8dea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:07.325889 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-66a2bd9e-f961-4a33-8bcd-372101ba8dea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:07.327402 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-66a2bd9e-f961-4a33-8bcd-372101ba8dea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:07.328563 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-66a2bd9e-f961-4a33-8bcd-372101ba8dea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.156438 Aug 18 14:31:07.329130 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 355/711] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:07 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:08.352190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6b84750b-1c25-44bc-b33b-b01e9e8c6b3d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:08.352802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6b84750b-1c25-44bc-b33b-b01e9e8c6b3d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:08.359345 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b84750b-1c25-44bc-b33b-b01e9e8c6b3d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:08.359873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b84750b-1c25-44bc-b33b-b01e9e8c6b3d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:08.360292 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b84750b-1c25-44bc-b33b-b01e9e8c6b3d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:08.361582 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b84750b-1c25-44bc-b33b-b01e9e8c6b3d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:08.362234 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b84750b-1c25-44bc-b33b-b01e9e8c6b3d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:08.362658 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b84750b-1c25-44bc-b33b-b01e9e8c6b3d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:08.731684 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6b84750b-1c25-44bc-b33b-b01e9e8c6b3d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:08.740047 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6b84750b-1c25-44bc-b33b-b01e9e8c6b3d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:08.741551 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6b84750b-1c25-44bc-b33b-b01e9e8c6b3d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:08.742707 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6b84750b-1c25-44bc-b33b-b01e9e8c6b3d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.394538 Aug 18 14:31:08.743264 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 357/712] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:08 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:09.765696 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1b1a4987-aa43-4284-9647-d1dc8e012c1a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:09.766313 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1b1a4987-aa43-4284-9647-d1dc8e012c1a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:09.773639 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b1a4987-aa43-4284-9647-d1dc8e012c1a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:09.774124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b1a4987-aa43-4284-9647-d1dc8e012c1a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:09.774565 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b1a4987-aa43-4284-9647-d1dc8e012c1a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:09.775290 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b1a4987-aa43-4284-9647-d1dc8e012c1a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:09.775769 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b1a4987-aa43-4284-9647-d1dc8e012c1a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:09.776194 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b1a4987-aa43-4284-9647-d1dc8e012c1a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:09.904800 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1b1a4987-aa43-4284-9647-d1dc8e012c1a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:09.913173 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1b1a4987-aa43-4284-9647-d1dc8e012c1a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:09.914706 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1b1a4987-aa43-4284-9647-d1dc8e012c1a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:09.915929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1b1a4987-aa43-4284-9647-d1dc8e012c1a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.154141 Aug 18 14:31:09.916500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 356/713] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:09 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:10.939347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bc87dff4-a558-44c2-ad94-36420322da73 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:10.940087 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bc87dff4-a558-44c2-ad94-36420322da73 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:10.946764 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc87dff4-a558-44c2-ad94-36420322da73 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:10.947527 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc87dff4-a558-44c2-ad94-36420322da73 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:10.948095 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc87dff4-a558-44c2-ad94-36420322da73 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:10.948961 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc87dff4-a558-44c2-ad94-36420322da73 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:10.949413 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc87dff4-a558-44c2-ad94-36420322da73 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:10.949832 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc87dff4-a558-44c2-ad94-36420322da73 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:11.079813 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bc87dff4-a558-44c2-ad94-36420322da73 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:11.088184 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bc87dff4-a558-44c2-ad94-36420322da73 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:11.089690 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bc87dff4-a558-44c2-ad94-36420322da73 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:11.091143 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bc87dff4-a558-44c2-ad94-36420322da73 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.156190 Aug 18 14:31:11.091734 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 358/714] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:10 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:12.115120 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-03c63a8c-17e8-4769-aba8-e187de3fb04e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:12.115756 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-03c63a8c-17e8-4769-aba8-e187de3fb04e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:12.122213 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03c63a8c-17e8-4769-aba8-e187de3fb04e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:12.122693 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03c63a8c-17e8-4769-aba8-e187de3fb04e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:12.123123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03c63a8c-17e8-4769-aba8-e187de3fb04e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:12.123839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03c63a8c-17e8-4769-aba8-e187de3fb04e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:12.124290 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03c63a8c-17e8-4769-aba8-e187de3fb04e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:12.124713 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03c63a8c-17e8-4769-aba8-e187de3fb04e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:12.256521 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-03c63a8c-17e8-4769-aba8-e187de3fb04e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:12.260136 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:31:12.265774 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-03c63a8c-17e8-4769-aba8-e187de3fb04e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:12.267262 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-03c63a8c-17e8-4769-aba8-e187de3fb04e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:12.268999 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-03c63a8c-17e8-4769-aba8-e187de3fb04e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.158589 Aug 18 14:31:12.269566 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 357/715] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:12 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:13.292338 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d3c72049-04de-41db-a655-a1e35a3257bf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:13.292991 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d3c72049-04de-41db-a655-a1e35a3257bf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:13.300267 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c72049-04de-41db-a655-a1e35a3257bf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:13.300697 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c72049-04de-41db-a655-a1e35a3257bf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:13.301139 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c72049-04de-41db-a655-a1e35a3257bf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:13.301828 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c72049-04de-41db-a655-a1e35a3257bf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:13.302283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c72049-04de-41db-a655-a1e35a3257bf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:13.302711 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c72049-04de-41db-a655-a1e35a3257bf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:13.434863 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d3c72049-04de-41db-a655-a1e35a3257bf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:13.443245 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d3c72049-04de-41db-a655-a1e35a3257bf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:13.444775 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d3c72049-04de-41db-a655-a1e35a3257bf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:13.445932 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d3c72049-04de-41db-a655-a1e35a3257bf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.157577 Aug 18 14:31:13.446533 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 359/716] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:13 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:14.468958 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3846d454-cef0-433c-bd76-51a93d544c56 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:14.469567 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3846d454-cef0-433c-bd76-51a93d544c56 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:14.477862 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3846d454-cef0-433c-bd76-51a93d544c56 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:14.478342 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3846d454-cef0-433c-bd76-51a93d544c56 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:14.478781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3846d454-cef0-433c-bd76-51a93d544c56 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:14.479508 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3846d454-cef0-433c-bd76-51a93d544c56 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:14.479955 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3846d454-cef0-433c-bd76-51a93d544c56 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:14.480375 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3846d454-cef0-433c-bd76-51a93d544c56 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:14.606967 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3846d454-cef0-433c-bd76-51a93d544c56 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:14.615682 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3846d454-cef0-433c-bd76-51a93d544c56 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:14.617484 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3846d454-cef0-433c-bd76-51a93d544c56 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:14.619187 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3846d454-cef0-433c-bd76-51a93d544c56 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.155269 Aug 18 14:31:14.619792 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 358/717] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:14 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:15.646567 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8d1e0fa4-88ac-4c74-bfcf-6fdd69fb73ea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:15.647103 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8d1e0fa4-88ac-4c74-bfcf-6fdd69fb73ea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:15.653524 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d1e0fa4-88ac-4c74-bfcf-6fdd69fb73ea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:15.654005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d1e0fa4-88ac-4c74-bfcf-6fdd69fb73ea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:15.654439 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d1e0fa4-88ac-4c74-bfcf-6fdd69fb73ea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:15.655122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d1e0fa4-88ac-4c74-bfcf-6fdd69fb73ea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:15.655598 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d1e0fa4-88ac-4c74-bfcf-6fdd69fb73ea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:15.656025 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d1e0fa4-88ac-4c74-bfcf-6fdd69fb73ea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:15.784125 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8d1e0fa4-88ac-4c74-bfcf-6fdd69fb73ea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:15.792124 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8d1e0fa4-88ac-4c74-bfcf-6fdd69fb73ea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:15.793620 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8d1e0fa4-88ac-4c74-bfcf-6fdd69fb73ea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:15.794767 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8d1e0fa4-88ac-4c74-bfcf-6fdd69fb73ea tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.152268 Aug 18 14:31:15.795325 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 360/718] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:15 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:16.817930 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-26033678-0fb6-468d-8c51-82832666cd3e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:16.818538 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-26033678-0fb6-468d-8c51-82832666cd3e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:16.824936 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26033678-0fb6-468d-8c51-82832666cd3e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:16.825411 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26033678-0fb6-468d-8c51-82832666cd3e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:16.825844 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26033678-0fb6-468d-8c51-82832666cd3e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:16.826527 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26033678-0fb6-468d-8c51-82832666cd3e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:16.826974 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26033678-0fb6-468d-8c51-82832666cd3e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:16.827417 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26033678-0fb6-468d-8c51-82832666cd3e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:16.958081 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26033678-0fb6-468d-8c51-82832666cd3e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:16.966456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26033678-0fb6-468d-8c51-82832666cd3e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:16.967979 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26033678-0fb6-468d-8c51-82832666cd3e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:16.969121 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-26033678-0fb6-468d-8c51-82832666cd3e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.155571 Aug 18 14:31:16.969678 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 359/719] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:16 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:17.994864 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1fea4e0a-1a1a-4491-8820-2a02ca413f64 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:17.995655 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1fea4e0a-1a1a-4491-8820-2a02ca413f64 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:18.002212 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fea4e0a-1a1a-4491-8820-2a02ca413f64 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:18.002691 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fea4e0a-1a1a-4491-8820-2a02ca413f64 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:18.003716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fea4e0a-1a1a-4491-8820-2a02ca413f64 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:18.004783 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fea4e0a-1a1a-4491-8820-2a02ca413f64 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:18.005238 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fea4e0a-1a1a-4491-8820-2a02ca413f64 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:18.005665 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fea4e0a-1a1a-4491-8820-2a02ca413f64 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:18.009808 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:31:18.135609 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1fea4e0a-1a1a-4491-8820-2a02ca413f64 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:18.143786 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1fea4e0a-1a1a-4491-8820-2a02ca413f64 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:18.145917 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1fea4e0a-1a1a-4491-8820-2a02ca413f64 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:18.147112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1fea4e0a-1a1a-4491-8820-2a02ca413f64 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.157990 Aug 18 14:31:18.147699 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 361/720] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:17 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:19.169623 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b4120fb6-72db-43b3-81ef-fc1e755c6dd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:19.170166 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b4120fb6-72db-43b3-81ef-fc1e755c6dd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:19.177528 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4120fb6-72db-43b3-81ef-fc1e755c6dd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:19.178009 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4120fb6-72db-43b3-81ef-fc1e755c6dd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:19.178442 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4120fb6-72db-43b3-81ef-fc1e755c6dd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:19.179136 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4120fb6-72db-43b3-81ef-fc1e755c6dd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:19.179622 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4120fb6-72db-43b3-81ef-fc1e755c6dd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:19.180047 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4120fb6-72db-43b3-81ef-fc1e755c6dd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:19.312202 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b4120fb6-72db-43b3-81ef-fc1e755c6dd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:19.320573 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b4120fb6-72db-43b3-81ef-fc1e755c6dd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:19.322066 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b4120fb6-72db-43b3-81ef-fc1e755c6dd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:19.323213 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b4120fb6-72db-43b3-81ef-fc1e755c6dd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.157561 Aug 18 14:31:19.323808 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 360/721] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:19 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:31:20.346320 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2e4ac72e-45b9-4e1d-91c1-43a549527365 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:20.347515 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2e4ac72e-45b9-4e1d-91c1-43a549527365 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:20.354143 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e4ac72e-45b9-4e1d-91c1-43a549527365 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:20.354618 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e4ac72e-45b9-4e1d-91c1-43a549527365 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:20.355047 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e4ac72e-45b9-4e1d-91c1-43a549527365 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:20.355754 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e4ac72e-45b9-4e1d-91c1-43a549527365 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:20.356201 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e4ac72e-45b9-4e1d-91c1-43a549527365 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:20.356620 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e4ac72e-45b9-4e1d-91c1-43a549527365 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:20.490924 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2e4ac72e-45b9-4e1d-91c1-43a549527365 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:20.499478 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2e4ac72e-45b9-4e1d-91c1-43a549527365 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:20.500975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2e4ac72e-45b9-4e1d-91c1-43a549527365 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:20.502119 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2e4ac72e-45b9-4e1d-91c1-43a549527365 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.159727 Aug 18 14:31:20.502679 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 362/722] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:20 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:21.525443 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2045d7c5-2e1e-4c47-b1e7-7a00669191e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:21.526063 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2045d7c5-2e1e-4c47-b1e7-7a00669191e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:21.528546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=44 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:31:21.534806 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2045d7c5-2e1e-4c47-b1e7-7a00669191e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:21.535480 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2045d7c5-2e1e-4c47-b1e7-7a00669191e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:21.535925 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2045d7c5-2e1e-4c47-b1e7-7a00669191e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:21.536627 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2045d7c5-2e1e-4c47-b1e7-7a00669191e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:21.537085 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2045d7c5-2e1e-4c47-b1e7-7a00669191e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:21.537519 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2045d7c5-2e1e-4c47-b1e7-7a00669191e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:21.666210 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2045d7c5-2e1e-4c47-b1e7-7a00669191e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:21.674452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2045d7c5-2e1e-4c47-b1e7-7a00669191e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:21.676583 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2045d7c5-2e1e-4c47-b1e7-7a00669191e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:21.677730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2045d7c5-2e1e-4c47-b1e7-7a00669191e8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.156297 Aug 18 14:31:21.678303 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 361/723] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:21 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:22.700566 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4aa6029b-135a-449f-819a-bf542dc98631 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:22.701185 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4aa6029b-135a-449f-819a-bf542dc98631 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:22.708349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4aa6029b-135a-449f-819a-bf542dc98631 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:22.708835 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4aa6029b-135a-449f-819a-bf542dc98631 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:22.709272 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4aa6029b-135a-449f-819a-bf542dc98631 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:22.709962 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4aa6029b-135a-449f-819a-bf542dc98631 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:22.710419 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4aa6029b-135a-449f-819a-bf542dc98631 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:22.710846 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4aa6029b-135a-449f-819a-bf542dc98631 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:22.836912 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4aa6029b-135a-449f-819a-bf542dc98631 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:22.845388 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4aa6029b-135a-449f-819a-bf542dc98631 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:22.847794 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4aa6029b-135a-449f-819a-bf542dc98631 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:22.849115 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4aa6029b-135a-449f-819a-bf542dc98631 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.152522 Aug 18 14:31:22.849688 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 363/724] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:22 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:23.872097 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-81e43750-1a7e-4f75-8a97-2265312ccca8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:23.872711 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-81e43750-1a7e-4f75-8a97-2265312ccca8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:23.879840 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81e43750-1a7e-4f75-8a97-2265312ccca8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:23.880317 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81e43750-1a7e-4f75-8a97-2265312ccca8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:23.880745 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81e43750-1a7e-4f75-8a97-2265312ccca8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:23.881427 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81e43750-1a7e-4f75-8a97-2265312ccca8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:23.881873 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81e43750-1a7e-4f75-8a97-2265312ccca8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:23.882292 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81e43750-1a7e-4f75-8a97-2265312ccca8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:24.015442 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81e43750-1a7e-4f75-8a97-2265312ccca8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:24.024150 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81e43750-1a7e-4f75-8a97-2265312ccca8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:24.025659 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81e43750-1a7e-4f75-8a97-2265312ccca8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:24.026811 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-81e43750-1a7e-4f75-8a97-2265312ccca8 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.158681 Aug 18 14:31:24.027429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 362/725] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:23 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:25.049413 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4085b422-384f-49a9-9e7d-9ecc3975a981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:25.050008 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4085b422-384f-49a9-9e7d-9ecc3975a981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:25.051878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=34 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:31:25.057628 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4085b422-384f-49a9-9e7d-9ecc3975a981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:25.058118 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4085b422-384f-49a9-9e7d-9ecc3975a981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:25.058587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4085b422-384f-49a9-9e7d-9ecc3975a981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:25.059281 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4085b422-384f-49a9-9e7d-9ecc3975a981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:25.059764 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4085b422-384f-49a9-9e7d-9ecc3975a981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:25.060195 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4085b422-384f-49a9-9e7d-9ecc3975a981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:25.190493 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4085b422-384f-49a9-9e7d-9ecc3975a981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:25.198834 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4085b422-384f-49a9-9e7d-9ecc3975a981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:25.200367 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4085b422-384f-49a9-9e7d-9ecc3975a981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:25.201527 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4085b422-384f-49a9-9e7d-9ecc3975a981 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.156304 Aug 18 14:31:25.202080 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 364/726] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:25 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:26.225760 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-075e27a8-a3c9-4a6c-8966-e8888b9761fe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:26.226369 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-075e27a8-a3c9-4a6c-8966-e8888b9761fe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:26.232807 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-075e27a8-a3c9-4a6c-8966-e8888b9761fe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:26.233281 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-075e27a8-a3c9-4a6c-8966-e8888b9761fe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:26.233709 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-075e27a8-a3c9-4a6c-8966-e8888b9761fe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:26.234390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-075e27a8-a3c9-4a6c-8966-e8888b9761fe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:26.234836 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-075e27a8-a3c9-4a6c-8966-e8888b9761fe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:26.235254 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-075e27a8-a3c9-4a6c-8966-e8888b9761fe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:26.364978 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-075e27a8-a3c9-4a6c-8966-e8888b9761fe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:26.372984 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-075e27a8-a3c9-4a6c-8966-e8888b9761fe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:26.374452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-075e27a8-a3c9-4a6c-8966-e8888b9761fe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:26.375660 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-075e27a8-a3c9-4a6c-8966-e8888b9761fe tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1744 microversion: 2.20 time: 0.154466 Aug 18 14:31:26.376222 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 363/727] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:26 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:27.398045 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9491aa86-a6c7-4ebb-9db9-15cff002e9a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:27.398660 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9491aa86-a6c7-4ebb-9db9-15cff002e9a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:27.405123 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9491aa86-a6c7-4ebb-9db9-15cff002e9a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:27.405606 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9491aa86-a6c7-4ebb-9db9-15cff002e9a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:27.406043 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9491aa86-a6c7-4ebb-9db9-15cff002e9a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:27.406733 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9491aa86-a6c7-4ebb-9db9-15cff002e9a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:27.407188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9491aa86-a6c7-4ebb-9db9-15cff002e9a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:27.407658 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9491aa86-a6c7-4ebb-9db9-15cff002e9a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:27.537183 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9491aa86-a6c7-4ebb-9db9-15cff002e9a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:27.545234 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9491aa86-a6c7-4ebb-9db9-15cff002e9a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:27.546742 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9491aa86-a6c7-4ebb-9db9-15cff002e9a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:27.547939 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9491aa86-a6c7-4ebb-9db9-15cff002e9a2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1744 microversion: 2.20 time: 0.153858 Aug 18 14:31:27.548502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 365/728] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:27 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:28.574998 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7abc87fd-58e7-42cf-909d-f7cc34898932 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:28.576582 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7abc87fd-58e7-42cf-909d-f7cc34898932 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:28.586223 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7abc87fd-58e7-42cf-909d-f7cc34898932 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:28.586713 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7abc87fd-58e7-42cf-909d-f7cc34898932 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:28.587153 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7abc87fd-58e7-42cf-909d-f7cc34898932 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:28.588523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7abc87fd-58e7-42cf-909d-f7cc34898932 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:28.588984 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7abc87fd-58e7-42cf-909d-f7cc34898932 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:28.589419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7abc87fd-58e7-42cf-909d-f7cc34898932 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:28.773574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7abc87fd-58e7-42cf-909d-f7cc34898932 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:28.786457 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7abc87fd-58e7-42cf-909d-f7cc34898932 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:28.788081 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7abc87fd-58e7-42cf-909d-f7cc34898932 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:28.789522 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7abc87fd-58e7-42cf-909d-f7cc34898932 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1739 microversion: 2.20 time: 0.219444 Aug 18 14:31:28.790096 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 364/729] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:28 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:31:29.814258 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e66df618-96ba-4f57-9928-66954bfc68c2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:29.815642 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e66df618-96ba-4f57-9928-66954bfc68c2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:29.822659 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e66df618-96ba-4f57-9928-66954bfc68c2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:29.823299 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e66df618-96ba-4f57-9928-66954bfc68c2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:29.823853 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e66df618-96ba-4f57-9928-66954bfc68c2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:29.824647 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e66df618-96ba-4f57-9928-66954bfc68c2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:29.825168 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e66df618-96ba-4f57-9928-66954bfc68c2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:29.825664 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e66df618-96ba-4f57-9928-66954bfc68c2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:29.993964 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e66df618-96ba-4f57-9928-66954bfc68c2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:30.005199 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e66df618-96ba-4f57-9928-66954bfc68c2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:30.006708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e66df618-96ba-4f57-9928-66954bfc68c2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:30.007930 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e66df618-96ba-4f57-9928-66954bfc68c2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1739 microversion: 2.20 time: 0.197565 Aug 18 14:31:30.009450 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 366/730] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:29 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:30.103738 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-38fa1536-a44f-478d-a767-32ea85e41add req-151adb23-6640-4bd1-8885-e3fc36511ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "910c9fdb-a6d3-4e60-843e-9e65d037ea71", "name": "network-vif-plugged", "status": "completed", "tag": "7ce6f5b2-32fa-4a9b-b50f-f6c24b537da8"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:31:30.121393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-38fa1536-a44f-478d-a767-32ea85e41add req-151adb23-6640-4bd1-8885-e3fc36511ee5 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:30.122273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-38fa1536-a44f-478d-a767-32ea85e41add req-151adb23-6640-4bd1-8885-e3fc36511ee5 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:30.122920 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-38fa1536-a44f-478d-a767-32ea85e41add req-151adb23-6640-4bd1-8885-e3fc36511ee5 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:30.142236 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-38fa1536-a44f-478d-a767-32ea85e41add req-151adb23-6640-4bd1-8885-e3fc36511ee5 service nova] Creating event network-vif-plugged:7ce6f5b2-32fa-4a9b-b50f-f6c24b537da8 for instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 on hv-cinder-85220 Aug 18 14:31:30.152612 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-38fa1536-a44f-478d-a767-32ea85e41add req-151adb23-6640-4bd1-8885-e3fc36511ee5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067713 Aug 18 14:31:30.153952 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 365/731] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:31:31.034240 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5e468461-e85f-4ca9-8400-3a8e9eb4ff79 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:31.039156 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5e468461-e85f-4ca9-8400-3a8e9eb4ff79 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:31.042258 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e468461-e85f-4ca9-8400-3a8e9eb4ff79 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:31.046672 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e468461-e85f-4ca9-8400-3a8e9eb4ff79 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:31.046672 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e468461-e85f-4ca9-8400-3a8e9eb4ff79 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:31.046672 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e468461-e85f-4ca9-8400-3a8e9eb4ff79 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:31.046672 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e468461-e85f-4ca9-8400-3a8e9eb4ff79 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:31.047111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e468461-e85f-4ca9-8400-3a8e9eb4ff79 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:31.202524 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5e468461-e85f-4ca9-8400-3a8e9eb4ff79 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:31.211626 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5e468461-e85f-4ca9-8400-3a8e9eb4ff79 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:31.213262 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5e468461-e85f-4ca9-8400-3a8e9eb4ff79 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:31.214455 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5e468461-e85f-4ca9-8400-3a8e9eb4ff79 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1739 microversion: 2.20 time: 0.184229 Aug 18 14:31:31.215021 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 367/732] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:31 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:32.243292 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-31661f9a-d9f4-4861-85ca-6045fea037e4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:32.244114 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-31661f9a-d9f4-4861-85ca-6045fea037e4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:32.251089 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31661f9a-d9f4-4861-85ca-6045fea037e4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:32.252152 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31661f9a-d9f4-4861-85ca-6045fea037e4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:32.252661 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31661f9a-d9f4-4861-85ca-6045fea037e4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:32.254053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31661f9a-d9f4-4861-85ca-6045fea037e4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:32.254515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31661f9a-d9f4-4861-85ca-6045fea037e4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:32.254952 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31661f9a-d9f4-4861-85ca-6045fea037e4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:32.417558 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-31661f9a-d9f4-4861-85ca-6045fea037e4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:32.428428 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-31661f9a-d9f4-4861-85ca-6045fea037e4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:32.429940 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-31661f9a-d9f4-4861-85ca-6045fea037e4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:32.431124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-31661f9a-d9f4-4861-85ca-6045fea037e4 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1739 microversion: 2.20 time: 0.193337 Aug 18 14:31:32.437043 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 366/733] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:32 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:33.460335 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-268bc67f-541e-44af-b979-083ff7a6732d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:33.461019 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-268bc67f-541e-44af-b979-083ff7a6732d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:33.467912 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-268bc67f-541e-44af-b979-083ff7a6732d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:33.468405 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-268bc67f-541e-44af-b979-083ff7a6732d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:33.468846 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-268bc67f-541e-44af-b979-083ff7a6732d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:33.469557 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-268bc67f-541e-44af-b979-083ff7a6732d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:33.470014 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-268bc67f-541e-44af-b979-083ff7a6732d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:33.470445 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-268bc67f-541e-44af-b979-083ff7a6732d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:33.617592 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-268bc67f-541e-44af-b979-083ff7a6732d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:33.626515 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-268bc67f-541e-44af-b979-083ff7a6732d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:33.628473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-268bc67f-541e-44af-b979-083ff7a6732d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:33.629704 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-268bc67f-541e-44af-b979-083ff7a6732d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1739 microversion: 2.20 time: 0.178559 Aug 18 14:31:33.630521 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 368/734] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:33 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:34.654300 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-27e59178-a0a5-4778-a21a-7f1b5c7928d6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:34.654861 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-27e59178-a0a5-4778-a21a-7f1b5c7928d6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:34.662328 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27e59178-a0a5-4778-a21a-7f1b5c7928d6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:34.662328 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27e59178-a0a5-4778-a21a-7f1b5c7928d6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:34.662620 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27e59178-a0a5-4778-a21a-7f1b5c7928d6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:34.663137 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27e59178-a0a5-4778-a21a-7f1b5c7928d6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:34.663645 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27e59178-a0a5-4778-a21a-7f1b5c7928d6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:34.664073 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27e59178-a0a5-4778-a21a-7f1b5c7928d6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:34.819904 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-27e59178-a0a5-4778-a21a-7f1b5c7928d6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:34.828667 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-27e59178-a0a5-4778-a21a-7f1b5c7928d6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:34.830162 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-27e59178-a0a5-4778-a21a-7f1b5c7928d6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:34.832043 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-27e59178-a0a5-4778-a21a-7f1b5c7928d6 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1739 microversion: 2.20 time: 0.181847 Aug 18 14:31:34.832804 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 367/735] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:34 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:35.856263 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e96bee9f-93d4-4bf8-9160-2f1b66eafcff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:35.856866 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e96bee9f-93d4-4bf8-9160-2f1b66eafcff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:35.866002 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e96bee9f-93d4-4bf8-9160-2f1b66eafcff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:35.866490 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e96bee9f-93d4-4bf8-9160-2f1b66eafcff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:35.866920 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e96bee9f-93d4-4bf8-9160-2f1b66eafcff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:35.867657 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e96bee9f-93d4-4bf8-9160-2f1b66eafcff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:35.868266 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e96bee9f-93d4-4bf8-9160-2f1b66eafcff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:35.868689 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e96bee9f-93d4-4bf8-9160-2f1b66eafcff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:35.995354 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-270934fa-5088-43ce-8472-4cd84219368a tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:31:35.998136 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-270934fa-5088-43ce-8472-4cd84219368a tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:36.005468 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-270934fa-5088-43ce-8472-4cd84219368a tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:36.006007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-270934fa-5088-43ce-8472-4cd84219368a tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:36.006436 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-270934fa-5088-43ce-8472-4cd84219368a tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:36.007216 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-270934fa-5088-43ce-8472-4cd84219368a tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:36.007702 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-270934fa-5088-43ce-8472-4cd84219368a tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:36.008131 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-270934fa-5088-43ce-8472-4cd84219368a tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:36.039519 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e96bee9f-93d4-4bf8-9160-2f1b66eafcff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:36.051726 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e96bee9f-93d4-4bf8-9160-2f1b66eafcff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:36.054488 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e96bee9f-93d4-4bf8-9160-2f1b66eafcff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:36.055801 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e96bee9f-93d4-4bf8-9160-2f1b66eafcff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1739 microversion: 2.20 time: 0.203434 Aug 18 14:31:36.056712 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 369/736] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:35 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:36.098219 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-270934fa-5088-43ce-8472-4cd84219368a tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "POST /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/action" status: 202 len: 0 microversion: 2.1 time: 0.106645 Aug 18 14:31:36.100494 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 368/737] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:31:35 2022] POST /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:31:36.109208 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f86d57ad-ee03-4cff-92c7-bbac0de5ba73 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:36.109839 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f86d57ad-ee03-4cff-92c7-bbac0de5ba73 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:36.116617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f86d57ad-ee03-4cff-92c7-bbac0de5ba73 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:36.117353 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f86d57ad-ee03-4cff-92c7-bbac0de5ba73 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:36.117869 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f86d57ad-ee03-4cff-92c7-bbac0de5ba73 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:36.118818 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f86d57ad-ee03-4cff-92c7-bbac0de5ba73 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:36.119385 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f86d57ad-ee03-4cff-92c7-bbac0de5ba73 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:36.120182 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f86d57ad-ee03-4cff-92c7-bbac0de5ba73 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:36.385124 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f86d57ad-ee03-4cff-92c7-bbac0de5ba73 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:36.394208 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f86d57ad-ee03-4cff-92c7-bbac0de5ba73 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1753 microversion: 2.1 time: 0.289530 Aug 18 14:31:36.395088 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 370/738] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:36 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1753 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:37.080133 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e15a4e5f-6bdd-4981-8158-6d28b193ca5b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:37.081756 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e15a4e5f-6bdd-4981-8158-6d28b193ca5b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:37.088658 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e15a4e5f-6bdd-4981-8158-6d28b193ca5b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:37.089138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e15a4e5f-6bdd-4981-8158-6d28b193ca5b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:37.089580 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e15a4e5f-6bdd-4981-8158-6d28b193ca5b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:37.092041 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e15a4e5f-6bdd-4981-8158-6d28b193ca5b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:37.092502 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e15a4e5f-6bdd-4981-8158-6d28b193ca5b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:37.092931 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e15a4e5f-6bdd-4981-8158-6d28b193ca5b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:37.249057 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e15a4e5f-6bdd-4981-8158-6d28b193ca5b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:37.258330 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e15a4e5f-6bdd-4981-8158-6d28b193ca5b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:37.260521 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e15a4e5f-6bdd-4981-8158-6d28b193ca5b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:37.261716 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e15a4e5f-6bdd-4981-8158-6d28b193ca5b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1739 microversion: 2.20 time: 0.186435 Aug 18 14:31:37.262285 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 369/739] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:37 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:31:37.417243 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-60dafc16-2f7f-4aba-b0f0-6015db87103d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:37.417900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-60dafc16-2f7f-4aba-b0f0-6015db87103d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:37.424553 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60dafc16-2f7f-4aba-b0f0-6015db87103d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:37.425888 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60dafc16-2f7f-4aba-b0f0-6015db87103d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:37.426500 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60dafc16-2f7f-4aba-b0f0-6015db87103d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:37.427197 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60dafc16-2f7f-4aba-b0f0-6015db87103d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:37.427685 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60dafc16-2f7f-4aba-b0f0-6015db87103d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:37.428109 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60dafc16-2f7f-4aba-b0f0-6015db87103d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:37.573966 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-60dafc16-2f7f-4aba-b0f0-6015db87103d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:37.582384 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-60dafc16-2f7f-4aba-b0f0-6015db87103d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.168884 Aug 18 14:31:37.582889 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 371/740] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:37 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:38.284499 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bbfb7294-a64e-4e00-8736-b88120ad89b1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:38.285349 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bbfb7294-a64e-4e00-8736-b88120ad89b1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:38.291989 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbfb7294-a64e-4e00-8736-b88120ad89b1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:38.292471 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbfb7294-a64e-4e00-8736-b88120ad89b1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:38.292900 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbfb7294-a64e-4e00-8736-b88120ad89b1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:38.293602 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbfb7294-a64e-4e00-8736-b88120ad89b1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:38.294038 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbfb7294-a64e-4e00-8736-b88120ad89b1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:38.294456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbfb7294-a64e-4e00-8736-b88120ad89b1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:38.425864 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bbfb7294-a64e-4e00-8736-b88120ad89b1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:38.433889 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bbfb7294-a64e-4e00-8736-b88120ad89b1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:38.435380 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bbfb7294-a64e-4e00-8736-b88120ad89b1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:38.436525 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bbfb7294-a64e-4e00-8736-b88120ad89b1 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1721 microversion: 2.20 time: 0.156581 Aug 18 14:31:38.437082 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 370/741] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:38 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:38.603081 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-73299cc4-ede3-47b9-8c2b-8c3e20e3cf7d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:38.603729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-73299cc4-ede3-47b9-8c2b-8c3e20e3cf7d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:38.610064 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73299cc4-ede3-47b9-8c2b-8c3e20e3cf7d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:38.610538 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73299cc4-ede3-47b9-8c2b-8c3e20e3cf7d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:38.610965 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73299cc4-ede3-47b9-8c2b-8c3e20e3cf7d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:38.611699 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73299cc4-ede3-47b9-8c2b-8c3e20e3cf7d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:38.612724 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73299cc4-ede3-47b9-8c2b-8c3e20e3cf7d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:38.613353 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73299cc4-ede3-47b9-8c2b-8c3e20e3cf7d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:38.728228 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dee6bad6-e993-4faa-ab3b-4987d2ad002f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:38.728718 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dee6bad6-e993-4faa-ab3b-4987d2ad002f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:38.734517 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dee6bad6-e993-4faa-ab3b-4987d2ad002f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:38.735211 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dee6bad6-e993-4faa-ab3b-4987d2ad002f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:38.735683 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dee6bad6-e993-4faa-ab3b-4987d2ad002f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:38.736378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dee6bad6-e993-4faa-ab3b-4987d2ad002f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:38.737364 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dee6bad6-e993-4faa-ab3b-4987d2ad002f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:38.738065 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dee6bad6-e993-4faa-ab3b-4987d2ad002f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:38.755905 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-73299cc4-ede3-47b9-8c2b-8c3e20e3cf7d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:38.761828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dee6bad6-e993-4faa-ab3b-4987d2ad002f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/ips" status: 200 len: 150 microversion: 2.1 time: 0.037371 Aug 18 14:31:38.762404 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 371/742] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Aug 18 14:31:38 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:31:38.764252 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-73299cc4-ede3-47b9-8c2b-8c3e20e3cf7d tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.165049 Aug 18 14:31:38.764803 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 372/743] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:38 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:39.460197 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1233e94c-b4ef-4e2a-8a77-b4ddae27f271 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:39.460807 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1233e94c-b4ef-4e2a-8a77-b4ddae27f271 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:39.467443 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1233e94c-b4ef-4e2a-8a77-b4ddae27f271 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:39.467920 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1233e94c-b4ef-4e2a-8a77-b4ddae27f271 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:39.468350 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1233e94c-b4ef-4e2a-8a77-b4ddae27f271 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:39.469027 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1233e94c-b4ef-4e2a-8a77-b4ddae27f271 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:39.469474 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1233e94c-b4ef-4e2a-8a77-b4ddae27f271 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:39.469893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1233e94c-b4ef-4e2a-8a77-b4ddae27f271 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:39.602167 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1233e94c-b4ef-4e2a-8a77-b4ddae27f271 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:39.610493 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1233e94c-b4ef-4e2a-8a77-b4ddae27f271 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:39.611934 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1233e94c-b4ef-4e2a-8a77-b4ddae27f271 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:39.613652 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1233e94c-b4ef-4e2a-8a77-b4ddae27f271 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1721 microversion: 2.20 time: 0.157482 Aug 18 14:31:39.614207 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 372/744] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:39 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:39.785614 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4e6926f1-c977-4050-a953-ae18e2a70e27 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:39.786231 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4e6926f1-c977-4050-a953-ae18e2a70e27 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:39.792616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e6926f1-c977-4050-a953-ae18e2a70e27 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:39.793100 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e6926f1-c977-4050-a953-ae18e2a70e27 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:39.793536 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e6926f1-c977-4050-a953-ae18e2a70e27 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:39.794221 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e6926f1-c977-4050-a953-ae18e2a70e27 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:39.794675 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e6926f1-c977-4050-a953-ae18e2a70e27 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:39.795099 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e6926f1-c977-4050-a953-ae18e2a70e27 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:39.939619 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4e6926f1-c977-4050-a953-ae18e2a70e27 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:39.948537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4e6926f1-c977-4050-a953-ae18e2a70e27 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.166941 Aug 18 14:31:39.949103 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 373/745] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:39 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:40.082489 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ca700040-ff7c-4d35-8857-d2476c0c1897 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8df8b74a-5db9-40c9-8021-1b175f5cde63"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:31:40.084828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ca700040-ff7c-4d35-8857-d2476c0c1897 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:40.090950 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca700040-ff7c-4d35-8857-d2476c0c1897 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:40.091468 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca700040-ff7c-4d35-8857-d2476c0c1897 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:40.091914 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca700040-ff7c-4d35-8857-d2476c0c1897 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:40.092605 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca700040-ff7c-4d35-8857-d2476c0c1897 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:40.093059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca700040-ff7c-4d35-8857-d2476c0c1897 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:40.093486 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca700040-ff7c-4d35-8857-d2476c0c1897 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:40.348858 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:31:40.374310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ca700040-ff7c-4d35-8857-d2476c0c1897 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "POST /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295727 Aug 18 14:31:40.374959 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 373/746] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:31:40 2022] POST /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:31:40.636779 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-06a42560-2ff2-4893-a582-140c78d2600b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:40.637307 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-06a42560-2ff2-4893-a582-140c78d2600b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:40.644572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06a42560-2ff2-4893-a582-140c78d2600b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:40.645190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06a42560-2ff2-4893-a582-140c78d2600b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:40.645633 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06a42560-2ff2-4893-a582-140c78d2600b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:40.646356 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06a42560-2ff2-4893-a582-140c78d2600b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:40.646973 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06a42560-2ff2-4893-a582-140c78d2600b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:40.647330 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06a42560-2ff2-4893-a582-140c78d2600b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:40.791499 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-06a42560-2ff2-4893-a582-140c78d2600b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:40.800459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-06a42560-2ff2-4893-a582-140c78d2600b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:40.802026 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-06a42560-2ff2-4893-a582-140c78d2600b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:40.803226 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-06a42560-2ff2-4893-a582-140c78d2600b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1724 microversion: 2.20 time: 0.170410 Aug 18 14:31:40.803835 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 374/747] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:40 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:40.826624 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0c307c2e-ef5f-4336-80c9-d68359f673fb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "191d2c08-fee7-4b9d-a961-aafb0a53da8b"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:31:40.829202 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0c307c2e-ef5f-4336-80c9-d68359f673fb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:40.835989 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c307c2e-ef5f-4336-80c9-d68359f673fb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:40.836472 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c307c2e-ef5f-4336-80c9-d68359f673fb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:40.836914 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c307c2e-ef5f-4336-80c9-d68359f673fb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:40.837610 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c307c2e-ef5f-4336-80c9-d68359f673fb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:40.838063 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c307c2e-ef5f-4336-80c9-d68359f673fb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:40.838497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c307c2e-ef5f-4336-80c9-d68359f673fb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:40.969778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bf1fce1b-2b6f-4d25-b6ee-0a3c9f9bb587 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:40.970410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bf1fce1b-2b6f-4d25-b6ee-0a3c9f9bb587 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:40.977136 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf1fce1b-2b6f-4d25-b6ee-0a3c9f9bb587 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:40.977604 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf1fce1b-2b6f-4d25-b6ee-0a3c9f9bb587 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:40.978041 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf1fce1b-2b6f-4d25-b6ee-0a3c9f9bb587 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:40.978729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf1fce1b-2b6f-4d25-b6ee-0a3c9f9bb587 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:40.979392 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf1fce1b-2b6f-4d25-b6ee-0a3c9f9bb587 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:40.979825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf1fce1b-2b6f-4d25-b6ee-0a3c9f9bb587 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:41.122406 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0c307c2e-ef5f-4336-80c9-d68359f673fb tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "POST /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300438 Aug 18 14:31:41.122999 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 374/748] 10.222.0.39 () {62 vars in 1364 bytes} [Thu Aug 18 14:31:40 2022] POST /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 14:31:41.137039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bf1fce1b-2b6f-4d25-b6ee-0a3c9f9bb587 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:41.146745 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bf1fce1b-2b6f-4d25-b6ee-0a3c9f9bb587 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.180630 Aug 18 14:31:41.147343 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 375/749] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:40 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:31:41.244398 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c9fb9fff-22f6-4c40-8883-668bfa846248 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:41.244901 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c9fb9fff-22f6-4c40-8883-668bfa846248 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:41.251833 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9fb9fff-22f6-4c40-8883-668bfa846248 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:41.252318 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9fb9fff-22f6-4c40-8883-668bfa846248 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:41.253298 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9fb9fff-22f6-4c40-8883-668bfa846248 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:41.253992 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9fb9fff-22f6-4c40-8883-668bfa846248 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:41.254443 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9fb9fff-22f6-4c40-8883-668bfa846248 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:41.254869 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9fb9fff-22f6-4c40-8883-668bfa846248 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:41.476819 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c9fb9fff-22f6-4c40-8883-668bfa846248 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "DELETE /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/os-volume_attachments/191d2c08-fee7-4b9d-a961-aafb0a53da8b" status: 202 len: 0 microversion: 2.20 time: 0.236237 Aug 18 14:31:41.477424 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 375/750] 10.222.0.39 () {60 vars in 1457 bytes} [Thu Aug 18 14:31:41 2022] DELETE /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/os-volume_attachments/191d2c08-fee7-4b9d-a961-aafb0a53da8b => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:31:41.539631 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-46b2cc77-f82f-490e-81ae-867eb127514e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:31:41.540221 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-46b2cc77-f82f-490e-81ae-867eb127514e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:41.546291 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b2cc77-f82f-490e-81ae-867eb127514e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:41.546768 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b2cc77-f82f-490e-81ae-867eb127514e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:41.547197 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b2cc77-f82f-490e-81ae-867eb127514e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:41.547910 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b2cc77-f82f-490e-81ae-867eb127514e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:41.548356 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b2cc77-f82f-490e-81ae-867eb127514e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:41.548775 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b2cc77-f82f-490e-81ae-867eb127514e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:41.577364 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-46b2cc77-f82f-490e-81ae-867eb127514e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120538) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 14:31:41.631501 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:31:41.646469 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-46b2cc77-f82f-490e-81ae-867eb127514e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "POST /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/action" status: 202 len: 0 microversion: 2.20 time: 0.110660 Aug 18 14:31:41.647077 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 376/751] 10.222.0.39 () {62 vars in 1319 bytes} [Thu Aug 18 14:31:41 2022] POST /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:31:41.655318 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a0c73284-060a-4439-a752-3adf02a6b7ed tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:41.656054 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a0c73284-060a-4439-a752-3adf02a6b7ed tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:41.662747 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0c73284-060a-4439-a752-3adf02a6b7ed tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:41.663236 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0c73284-060a-4439-a752-3adf02a6b7ed tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:41.663700 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0c73284-060a-4439-a752-3adf02a6b7ed tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:41.664398 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0c73284-060a-4439-a752-3adf02a6b7ed tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:41.664857 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0c73284-060a-4439-a752-3adf02a6b7ed tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:41.665284 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0c73284-060a-4439-a752-3adf02a6b7ed tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:41.813888 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a0c73284-060a-4439-a752-3adf02a6b7ed tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:41.823352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a0c73284-060a-4439-a752-3adf02a6b7ed tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:41.824867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a0c73284-060a-4439-a752-3adf02a6b7ed tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:41.826013 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a0c73284-060a-4439-a752-3adf02a6b7ed tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1672 microversion: 2.20 time: 0.174709 Aug 18 14:31:41.827454 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 376/752] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:41 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:31:42.107603 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-6ca7acae-a15d-4486-80f1-9076ace7ab75 req-353e4e98-745d-48f7-83ea-605598ae627b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "910c9fdb-a6d3-4e60-843e-9e65d037ea71", "name": "network-vif-unplugged", "status": "completed", "tag": "7ce6f5b2-32fa-4a9b-b50f-f6c24b537da8"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:31:42.122013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6ca7acae-a15d-4486-80f1-9076ace7ab75 req-353e4e98-745d-48f7-83ea-605598ae627b service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:42.122495 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6ca7acae-a15d-4486-80f1-9076ace7ab75 req-353e4e98-745d-48f7-83ea-605598ae627b service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:42.122923 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6ca7acae-a15d-4486-80f1-9076ace7ab75 req-353e4e98-745d-48f7-83ea-605598ae627b service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:42.136549 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.compute.server_external_events [req-6ca7acae-a15d-4486-80f1-9076ace7ab75 req-353e4e98-745d-48f7-83ea-605598ae627b service nova] Unable to find a host for instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71. Dropping event network-vif-unplugged {{(pid=120538) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 14:31:42.137669 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-6ca7acae-a15d-4486-80f1-9076ace7ab75 req-353e4e98-745d-48f7-83ea-605598ae627b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036577 Aug 18 14:31:42.138425 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 377/753] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 18 14:31:42.168157 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-41108e04-47b2-418c-bc87-b105cc85379c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:42.168968 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-41108e04-47b2-418c-bc87-b105cc85379c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:42.175984 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41108e04-47b2-418c-bc87-b105cc85379c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:42.176716 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41108e04-47b2-418c-bc87-b105cc85379c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:42.177377 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41108e04-47b2-418c-bc87-b105cc85379c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:42.178087 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41108e04-47b2-418c-bc87-b105cc85379c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:42.178546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41108e04-47b2-418c-bc87-b105cc85379c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:42.179016 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41108e04-47b2-418c-bc87-b105cc85379c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:42.326315 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-41108e04-47b2-418c-bc87-b105cc85379c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:42.335635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-41108e04-47b2-418c-bc87-b105cc85379c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.171410 Aug 18 14:31:42.336201 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 377/754] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:42 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:42.849892 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ec98ba2a-26e6-43b7-b306-ca69b8d72583 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:42.850496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ec98ba2a-26e6-43b7-b306-ca69b8d72583 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:42.856342 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec98ba2a-26e6-43b7-b306-ca69b8d72583 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:42.856814 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec98ba2a-26e6-43b7-b306-ca69b8d72583 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:42.857246 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec98ba2a-26e6-43b7-b306-ca69b8d72583 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:42.857919 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec98ba2a-26e6-43b7-b306-ca69b8d72583 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:42.858364 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec98ba2a-26e6-43b7-b306-ca69b8d72583 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:42.858783 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec98ba2a-26e6-43b7-b306-ca69b8d72583 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:43.019386 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ec98ba2a-26e6-43b7-b306-ca69b8d72583 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:43.028127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ec98ba2a-26e6-43b7-b306-ca69b8d72583 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:43.029642 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ec98ba2a-26e6-43b7-b306-ca69b8d72583 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:43.030787 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ec98ba2a-26e6-43b7-b306-ca69b8d72583 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.184897 Aug 18 14:31:43.031342 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 378/755] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:42 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:43.357421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4b35041a-dc33-4dce-8340-72a9d7b4dea8 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:43.358126 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4b35041a-dc33-4dce-8340-72a9d7b4dea8 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:43.365621 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b35041a-dc33-4dce-8340-72a9d7b4dea8 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:43.366112 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b35041a-dc33-4dce-8340-72a9d7b4dea8 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:43.366557 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b35041a-dc33-4dce-8340-72a9d7b4dea8 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:43.367263 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b35041a-dc33-4dce-8340-72a9d7b4dea8 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:43.367749 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b35041a-dc33-4dce-8340-72a9d7b4dea8 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:43.368179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b35041a-dc33-4dce-8340-72a9d7b4dea8 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:43.513455 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4b35041a-dc33-4dce-8340-72a9d7b4dea8 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:43.528403 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4b35041a-dc33-4dce-8340-72a9d7b4dea8 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.175264 Aug 18 14:31:43.528994 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 378/756] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:43 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:44.055712 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0a7bc273-b71b-403a-9694-e4b1d18256e9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:44.057062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0a7bc273-b71b-403a-9694-e4b1d18256e9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:44.065644 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a7bc273-b71b-403a-9694-e4b1d18256e9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:44.066607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a7bc273-b71b-403a-9694-e4b1d18256e9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:44.067301 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a7bc273-b71b-403a-9694-e4b1d18256e9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:44.068387 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a7bc273-b71b-403a-9694-e4b1d18256e9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:44.069082 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a7bc273-b71b-403a-9694-e4b1d18256e9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:44.069791 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a7bc273-b71b-403a-9694-e4b1d18256e9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:44.241551 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0a7bc273-b71b-403a-9694-e4b1d18256e9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:44.250724 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0a7bc273-b71b-403a-9694-e4b1d18256e9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:44.252289 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0a7bc273-b71b-403a-9694-e4b1d18256e9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:44.253512 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0a7bc273-b71b-403a-9694-e4b1d18256e9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.202098 Aug 18 14:31:44.264356 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 379/757] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:44 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:44.278416 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ca6eb9c4-ae80-4141-aabe-5204c90cdc05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:44.279264 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ca6eb9c4-ae80-4141-aabe-5204c90cdc05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:44.286286 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca6eb9c4-ae80-4141-aabe-5204c90cdc05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:44.286771 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca6eb9c4-ae80-4141-aabe-5204c90cdc05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:44.287210 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca6eb9c4-ae80-4141-aabe-5204c90cdc05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:44.288015 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca6eb9c4-ae80-4141-aabe-5204c90cdc05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:44.288477 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca6eb9c4-ae80-4141-aabe-5204c90cdc05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:44.288905 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca6eb9c4-ae80-4141-aabe-5204c90cdc05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:44.314114 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ca6eb9c4-ae80-4141-aabe-5204c90cdc05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/ips" status: 200 len: 143 microversion: 2.1 time: 0.039596 Aug 18 14:31:44.315698 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 379/758] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Aug 18 14:31:44 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/ips => generated 143 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:31:44.551455 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b9db6525-ca97-46a2-a378-6cf1fee290b9 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:44.552604 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b9db6525-ca97-46a2-a378-6cf1fee290b9 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:44.559300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9db6525-ca97-46a2-a378-6cf1fee290b9 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:44.559949 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9db6525-ca97-46a2-a378-6cf1fee290b9 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:44.560478 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9db6525-ca97-46a2-a378-6cf1fee290b9 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:44.561305 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9db6525-ca97-46a2-a378-6cf1fee290b9 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:44.561866 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9db6525-ca97-46a2-a378-6cf1fee290b9 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:44.562515 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9db6525-ca97-46a2-a378-6cf1fee290b9 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:44.740173 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b9db6525-ca97-46a2-a378-6cf1fee290b9 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:44.748535 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b9db6525-ca97-46a2-a378-6cf1fee290b9 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.202049 Aug 18 14:31:44.749120 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 380/759] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:44 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:45.276680 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-949c7cf5-95c3-459c-a158-578e2fbdf06e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:45.277301 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-949c7cf5-95c3-459c-a158-578e2fbdf06e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:45.283712 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-949c7cf5-95c3-459c-a158-578e2fbdf06e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:45.284952 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-949c7cf5-95c3-459c-a158-578e2fbdf06e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:45.285387 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-949c7cf5-95c3-459c-a158-578e2fbdf06e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:45.286274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-949c7cf5-95c3-459c-a158-578e2fbdf06e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:45.286732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-949c7cf5-95c3-459c-a158-578e2fbdf06e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:45.287157 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-949c7cf5-95c3-459c-a158-578e2fbdf06e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:45.444001 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-949c7cf5-95c3-459c-a158-578e2fbdf06e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:45.452467 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-949c7cf5-95c3-459c-a158-578e2fbdf06e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:45.453964 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-949c7cf5-95c3-459c-a158-578e2fbdf06e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:45.455128 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-949c7cf5-95c3-459c-a158-578e2fbdf06e tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.182369 Aug 18 14:31:45.456279 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 380/760] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:45 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:45.771777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5afe7a30-2d23-4011-be23-4e7a91d88ef2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:45.772516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5afe7a30-2d23-4011-be23-4e7a91d88ef2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:45.779925 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5afe7a30-2d23-4011-be23-4e7a91d88ef2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:45.780842 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5afe7a30-2d23-4011-be23-4e7a91d88ef2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:45.781451 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5afe7a30-2d23-4011-be23-4e7a91d88ef2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:45.782409 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5afe7a30-2d23-4011-be23-4e7a91d88ef2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:45.783356 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5afe7a30-2d23-4011-be23-4e7a91d88ef2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:45.784054 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5afe7a30-2d23-4011-be23-4e7a91d88ef2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:45.960991 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5afe7a30-2d23-4011-be23-4e7a91d88ef2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:45.972122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5afe7a30-2d23-4011-be23-4e7a91d88ef2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.204505 Aug 18 14:31:45.983847 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 381/761] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:45 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:46.484610 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a706727f-1d77-49ff-95ee-044922cd8333 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:46.485274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a706727f-1d77-49ff-95ee-044922cd8333 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:46.493154 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a706727f-1d77-49ff-95ee-044922cd8333 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:46.493652 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a706727f-1d77-49ff-95ee-044922cd8333 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:46.494087 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a706727f-1d77-49ff-95ee-044922cd8333 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:46.494793 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a706727f-1d77-49ff-95ee-044922cd8333 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:46.495244 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a706727f-1d77-49ff-95ee-044922cd8333 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:46.495699 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a706727f-1d77-49ff-95ee-044922cd8333 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:46.641825 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a706727f-1d77-49ff-95ee-044922cd8333 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:46.650605 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a706727f-1d77-49ff-95ee-044922cd8333 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:46.652128 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a706727f-1d77-49ff-95ee-044922cd8333 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:46.653280 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a706727f-1d77-49ff-95ee-044922cd8333 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.172723 Aug 18 14:31:46.653839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 381/762] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:46 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:46.994102 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bbac96c9-d674-4a0d-8504-43861e6eed22 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:46.994832 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bbac96c9-d674-4a0d-8504-43861e6eed22 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:47.001536 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbac96c9-d674-4a0d-8504-43861e6eed22 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:47.002045 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbac96c9-d674-4a0d-8504-43861e6eed22 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:47.003113 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbac96c9-d674-4a0d-8504-43861e6eed22 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:47.004051 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbac96c9-d674-4a0d-8504-43861e6eed22 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:47.004503 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbac96c9-d674-4a0d-8504-43861e6eed22 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:47.004929 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbac96c9-d674-4a0d-8504-43861e6eed22 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:47.173928 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bbac96c9-d674-4a0d-8504-43861e6eed22 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:47.177542 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cd88f19c-d7cf-491f-a360-e6c6eb0d8c9a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43a4b5a1-e44c-48d4-bfaa-320364083e19"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:31:47.181909 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cd88f19c-d7cf-491f-a360-e6c6eb0d8c9a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:47.183553 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bbac96c9-d674-4a0d-8504-43861e6eed22 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.193180 Aug 18 14:31:47.184209 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 382/763] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:46 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:47.195839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd88f19c-d7cf-491f-a360-e6c6eb0d8c9a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:47.195839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd88f19c-d7cf-491f-a360-e6c6eb0d8c9a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:47.195839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd88f19c-d7cf-491f-a360-e6c6eb0d8c9a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:47.195839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd88f19c-d7cf-491f-a360-e6c6eb0d8c9a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:47.196222 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd88f19c-d7cf-491f-a360-e6c6eb0d8c9a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:47.196222 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd88f19c-d7cf-491f-a360-e6c6eb0d8c9a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:47.678835 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3bb63695-736c-48ff-9872-12c12e2fbaaf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:47.679352 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3bb63695-736c-48ff-9872-12c12e2fbaaf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:47.685252 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bb63695-736c-48ff-9872-12c12e2fbaaf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:47.685733 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bb63695-736c-48ff-9872-12c12e2fbaaf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:47.686162 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bb63695-736c-48ff-9872-12c12e2fbaaf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:47.686842 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bb63695-736c-48ff-9872-12c12e2fbaaf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:47.687291 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bb63695-736c-48ff-9872-12c12e2fbaaf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:47.687743 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bb63695-736c-48ff-9872-12c12e2fbaaf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:47.844409 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3bb63695-736c-48ff-9872-12c12e2fbaaf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:47.853320 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3bb63695-736c-48ff-9872-12c12e2fbaaf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:47.854792 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3bb63695-736c-48ff-9872-12c12e2fbaaf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:47.856129 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3bb63695-736c-48ff-9872-12c12e2fbaaf tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.181544 Aug 18 14:31:47.856569 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 383/764] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:47 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:31:48.206784 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d9cc9438-86a2-41b9-80e0-0d2ca2234915 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:48.207562 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d9cc9438-86a2-41b9-80e0-0d2ca2234915 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:48.214162 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9cc9438-86a2-41b9-80e0-0d2ca2234915 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:48.214924 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9cc9438-86a2-41b9-80e0-0d2ca2234915 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:48.215641 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9cc9438-86a2-41b9-80e0-0d2ca2234915 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:48.216340 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9cc9438-86a2-41b9-80e0-0d2ca2234915 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:48.216812 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9cc9438-86a2-41b9-80e0-0d2ca2234915 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:48.217231 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9cc9438-86a2-41b9-80e0-0d2ca2234915 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:48.386600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d9cc9438-86a2-41b9-80e0-0d2ca2234915 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:48.395966 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d9cc9438-86a2-41b9-80e0-0d2ca2234915 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.193538 Aug 18 14:31:48.396536 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 384/765] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:48 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:31:48.880573 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7cb5c448-630e-4d70-967e-4d2728da4783 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:48.881434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7cb5c448-630e-4d70-967e-4d2728da4783 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:48.888129 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cb5c448-630e-4d70-967e-4d2728da4783 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:48.888709 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cb5c448-630e-4d70-967e-4d2728da4783 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:48.889217 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cb5c448-630e-4d70-967e-4d2728da4783 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:48.892066 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cb5c448-630e-4d70-967e-4d2728da4783 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:48.892645 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cb5c448-630e-4d70-967e-4d2728da4783 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:48.893406 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cb5c448-630e-4d70-967e-4d2728da4783 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:49.051777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7cb5c448-630e-4d70-967e-4d2728da4783 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:49.060321 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7cb5c448-630e-4d70-967e-4d2728da4783 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:49.061855 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7cb5c448-630e-4d70-967e-4d2728da4783 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:49.063018 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7cb5c448-630e-4d70-967e-4d2728da4783 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.186888 Aug 18 14:31:49.063792 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 385/766] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:48 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:49.418207 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-10c24d8a-b19d-465f-b2cc-de175992d8d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:49.419045 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-10c24d8a-b19d-465f-b2cc-de175992d8d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:49.427299 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10c24d8a-b19d-465f-b2cc-de175992d8d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:49.428013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10c24d8a-b19d-465f-b2cc-de175992d8d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:49.428481 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10c24d8a-b19d-465f-b2cc-de175992d8d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:49.429152 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10c24d8a-b19d-465f-b2cc-de175992d8d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:49.429596 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10c24d8a-b19d-465f-b2cc-de175992d8d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:49.430205 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10c24d8a-b19d-465f-b2cc-de175992d8d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:49.592000 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-10c24d8a-b19d-465f-b2cc-de175992d8d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:49.614000 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-10c24d8a-b19d-465f-b2cc-de175992d8d6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.199615 Aug 18 14:31:49.614513 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 386/767] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:49 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:31:50.087094 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b62b1cce-dfd5-4c45-a87e-8759eb6e3e59 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:50.089012 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b62b1cce-dfd5-4c45-a87e-8759eb6e3e59 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:50.096470 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b62b1cce-dfd5-4c45-a87e-8759eb6e3e59 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:50.097162 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b62b1cce-dfd5-4c45-a87e-8759eb6e3e59 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:50.097631 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b62b1cce-dfd5-4c45-a87e-8759eb6e3e59 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:50.098374 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b62b1cce-dfd5-4c45-a87e-8759eb6e3e59 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:50.098834 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b62b1cce-dfd5-4c45-a87e-8759eb6e3e59 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:50.102172 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b62b1cce-dfd5-4c45-a87e-8759eb6e3e59 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:50.264677 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b62b1cce-dfd5-4c45-a87e-8759eb6e3e59 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:50.274499 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b62b1cce-dfd5-4c45-a87e-8759eb6e3e59 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:50.276096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b62b1cce-dfd5-4c45-a87e-8759eb6e3e59 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:50.277258 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b62b1cce-dfd5-4c45-a87e-8759eb6e3e59 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.194082 Aug 18 14:31:50.277829 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 387/768] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:50 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:31:50.635878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cd08d735-45e6-4c88-beb2-b4e41b2eb57b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:50.636595 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cd08d735-45e6-4c88-beb2-b4e41b2eb57b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:50.643741 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd08d735-45e6-4c88-beb2-b4e41b2eb57b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:50.644231 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd08d735-45e6-4c88-beb2-b4e41b2eb57b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:50.644667 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd08d735-45e6-4c88-beb2-b4e41b2eb57b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:50.645374 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd08d735-45e6-4c88-beb2-b4e41b2eb57b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:50.645831 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd08d735-45e6-4c88-beb2-b4e41b2eb57b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:50.646260 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd08d735-45e6-4c88-beb2-b4e41b2eb57b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:50.806754 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cd08d735-45e6-4c88-beb2-b4e41b2eb57b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:50.816496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cd08d735-45e6-4c88-beb2-b4e41b2eb57b tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.184384 Aug 18 14:31:50.817074 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 388/769] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:50 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:31:51.302958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fb9b8fcf-733d-4f37-84e1-52b36719d11c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:51.303830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fb9b8fcf-733d-4f37-84e1-52b36719d11c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:51.310424 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb9b8fcf-733d-4f37-84e1-52b36719d11c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:51.310978 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb9b8fcf-733d-4f37-84e1-52b36719d11c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:51.311523 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb9b8fcf-733d-4f37-84e1-52b36719d11c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:51.312316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb9b8fcf-733d-4f37-84e1-52b36719d11c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:51.312850 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb9b8fcf-733d-4f37-84e1-52b36719d11c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:51.313323 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb9b8fcf-733d-4f37-84e1-52b36719d11c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:51.468653 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fb9b8fcf-733d-4f37-84e1-52b36719d11c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:51.478530 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fb9b8fcf-733d-4f37-84e1-52b36719d11c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:51.480340 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fb9b8fcf-733d-4f37-84e1-52b36719d11c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:51.481514 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fb9b8fcf-733d-4f37-84e1-52b36719d11c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.183533 Aug 18 14:31:51.482119 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 389/770] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:51 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:31:51.837942 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1e9c00a5-9a43-4141-8675-3c34bf92e155 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:51.838778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1e9c00a5-9a43-4141-8675-3c34bf92e155 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:51.845262 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e9c00a5-9a43-4141-8675-3c34bf92e155 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:51.845854 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e9c00a5-9a43-4141-8675-3c34bf92e155 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:51.846290 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e9c00a5-9a43-4141-8675-3c34bf92e155 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:51.847147 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e9c00a5-9a43-4141-8675-3c34bf92e155 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:51.847635 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e9c00a5-9a43-4141-8675-3c34bf92e155 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:51.848060 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e9c00a5-9a43-4141-8675-3c34bf92e155 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:51.995830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1e9c00a5-9a43-4141-8675-3c34bf92e155 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:52.005894 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1e9c00a5-9a43-4141-8675-3c34bf92e155 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.171733 Aug 18 14:31:52.006475 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 390/771] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:51 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:31:52.504367 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5e2e66e6-e25a-4bca-858f-bacf75a83c45 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:52.504977 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5e2e66e6-e25a-4bca-858f-bacf75a83c45 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:52.510911 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e2e66e6-e25a-4bca-858f-bacf75a83c45 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:52.511432 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e2e66e6-e25a-4bca-858f-bacf75a83c45 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:52.511901 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e2e66e6-e25a-4bca-858f-bacf75a83c45 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:52.512589 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e2e66e6-e25a-4bca-858f-bacf75a83c45 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:52.513044 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e2e66e6-e25a-4bca-858f-bacf75a83c45 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:52.513471 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e2e66e6-e25a-4bca-858f-bacf75a83c45 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:52.643627 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5e2e66e6-e25a-4bca-858f-bacf75a83c45 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:52.651884 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5e2e66e6-e25a-4bca-858f-bacf75a83c45 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:52.653385 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5e2e66e6-e25a-4bca-858f-bacf75a83c45 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:52.654547 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5e2e66e6-e25a-4bca-858f-bacf75a83c45 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.154101 Aug 18 14:31:52.655106 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 391/772] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:52 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:31:53.027495 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-277aee76-d29b-44f6-8f62-0565489f8ce4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:53.028243 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-277aee76-d29b-44f6-8f62-0565489f8ce4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:53.035009 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-277aee76-d29b-44f6-8f62-0565489f8ce4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:53.035531 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-277aee76-d29b-44f6-8f62-0565489f8ce4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:53.035964 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-277aee76-d29b-44f6-8f62-0565489f8ce4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:53.036650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-277aee76-d29b-44f6-8f62-0565489f8ce4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:53.037099 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-277aee76-d29b-44f6-8f62-0565489f8ce4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:53.037518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-277aee76-d29b-44f6-8f62-0565489f8ce4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:53.179322 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-277aee76-d29b-44f6-8f62-0565489f8ce4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:53.187698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-277aee76-d29b-44f6-8f62-0565489f8ce4 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.164305 Aug 18 14:31:53.188267 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 392/773] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:53 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:31:53.678320 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f0707d3d-2c63-4a70-afe3-a63fb4abb218 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:53.678922 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f0707d3d-2c63-4a70-afe3-a63fb4abb218 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:53.684871 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0707d3d-2c63-4a70-afe3-a63fb4abb218 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:53.685344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0707d3d-2c63-4a70-afe3-a63fb4abb218 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:53.685776 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0707d3d-2c63-4a70-afe3-a63fb4abb218 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:53.686453 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0707d3d-2c63-4a70-afe3-a63fb4abb218 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:53.686899 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0707d3d-2c63-4a70-afe3-a63fb4abb218 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:53.687320 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0707d3d-2c63-4a70-afe3-a63fb4abb218 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:53.817309 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f0707d3d-2c63-4a70-afe3-a63fb4abb218 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:53.825630 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f0707d3d-2c63-4a70-afe3-a63fb4abb218 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:53.827140 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f0707d3d-2c63-4a70-afe3-a63fb4abb218 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:53.828331 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f0707d3d-2c63-4a70-afe3-a63fb4abb218 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.154719 Aug 18 14:31:53.828887 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 393/774] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:53 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:31:54.068515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cd88f19c-d7cf-491f-a360-e6c6eb0d8c9a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "POST /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.897955 Aug 18 14:31:54.069114 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 382/775] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:31:47 2022] POST /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/os-volume_attachments => generated 194 bytes in 6900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:31:54.210673 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-84b6dd78-10be-43d8-925c-26cd71c0d513 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:54.211385 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-84b6dd78-10be-43d8-925c-26cd71c0d513 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:54.218035 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84b6dd78-10be-43d8-925c-26cd71c0d513 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:54.218447 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84b6dd78-10be-43d8-925c-26cd71c0d513 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:54.218876 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84b6dd78-10be-43d8-925c-26cd71c0d513 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:54.219588 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84b6dd78-10be-43d8-925c-26cd71c0d513 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:54.220038 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84b6dd78-10be-43d8-925c-26cd71c0d513 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:54.220457 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84b6dd78-10be-43d8-925c-26cd71c0d513 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:54.225385 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:31:54.393236 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-84b6dd78-10be-43d8-925c-26cd71c0d513 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:54.402967 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-84b6dd78-10be-43d8-925c-26cd71c0d513 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.196887 Aug 18 14:31:54.407418 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 394/776] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:54 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:54.853100 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0fbab96c-90bb-483b-ac56-12caaae0b93d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:54.853799 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0fbab96c-90bb-483b-ac56-12caaae0b93d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:54.855777 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=44 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:31:54.861787 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fbab96c-90bb-483b-ac56-12caaae0b93d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:54.862268 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fbab96c-90bb-483b-ac56-12caaae0b93d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:54.862705 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fbab96c-90bb-483b-ac56-12caaae0b93d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:54.863422 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fbab96c-90bb-483b-ac56-12caaae0b93d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:54.863878 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fbab96c-90bb-483b-ac56-12caaae0b93d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:54.864302 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fbab96c-90bb-483b-ac56-12caaae0b93d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:54.993475 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0fbab96c-90bb-483b-ac56-12caaae0b93d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:54.995707 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:UPDATE=11,nova_cell1:SELECT=82,nova_cell1:INSERT=7 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:31:55.003655 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0fbab96c-90bb-483b-ac56-12caaae0b93d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:55.005195 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0fbab96c-90bb-483b-ac56-12caaae0b93d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:55.006488 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0fbab96c-90bb-483b-ac56-12caaae0b93d tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.158911 Aug 18 14:31:55.007060 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 383/777] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:54 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:55.424153 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7f428ea1-b938-4b94-9a13-7e6ca6294bff tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:55.425108 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7f428ea1-b938-4b94-9a13-7e6ca6294bff tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:55.431774 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:31:55.433480 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f428ea1-b938-4b94-9a13-7e6ca6294bff tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:55.434028 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f428ea1-b938-4b94-9a13-7e6ca6294bff tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:55.434527 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f428ea1-b938-4b94-9a13-7e6ca6294bff tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:55.435518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f428ea1-b938-4b94-9a13-7e6ca6294bff tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:55.436040 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f428ea1-b938-4b94-9a13-7e6ca6294bff tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:55.436644 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f428ea1-b938-4b94-9a13-7e6ca6294bff tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:55.476786 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2cb794b5-f2c0-4ac0-8ea9-da74612e5e62 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:55.477337 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2cb794b5-f2c0-4ac0-8ea9-da74612e5e62 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:55.484055 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cb794b5-f2c0-4ac0-8ea9-da74612e5e62 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:55.484543 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cb794b5-f2c0-4ac0-8ea9-da74612e5e62 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:55.484977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cb794b5-f2c0-4ac0-8ea9-da74612e5e62 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:55.485669 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cb794b5-f2c0-4ac0-8ea9-da74612e5e62 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:55.486116 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cb794b5-f2c0-4ac0-8ea9-da74612e5e62 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:55.486537 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cb794b5-f2c0-4ac0-8ea9-da74612e5e62 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:55.571712 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-2cb794b5-f2c0-4ac0-8ea9-da74612e5e62 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lazy-loading 'services' on Instance uuid 86d8b41d-49fe-4ffd-9896-33f4a20a437b {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:31:55.585600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7f428ea1-b938-4b94-9a13-7e6ca6294bff tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:55.594130 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7f428ea1-b938-4b94-9a13-7e6ca6294bff tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.173893 Aug 18 14:31:55.594699 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 395/778] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:55 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:55.685115 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2cb794b5-f2c0-4ac0-8ea9-da74612e5e62 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments/8df8b74a-5db9-40c9-8021-1b175f5cde63" status: 202 len: 0 microversion: 2.1 time: 0.212774 Aug 18 14:31:55.685762 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 384/779] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Aug 18 14:31:55 2022] DELETE /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments/8df8b74a-5db9-40c9-8021-1b175f5cde63 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:31:55.695005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3737ab50-ae7f-4956-849c-c6f1ebf1a2d1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:55.697305 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3737ab50-ae7f-4956-849c-c6f1ebf1a2d1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:55.703944 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3737ab50-ae7f-4956-849c-c6f1ebf1a2d1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:55.704537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3737ab50-ae7f-4956-849c-c6f1ebf1a2d1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:55.704971 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3737ab50-ae7f-4956-849c-c6f1ebf1a2d1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:55.705662 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3737ab50-ae7f-4956-849c-c6f1ebf1a2d1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:55.706106 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3737ab50-ae7f-4956-849c-c6f1ebf1a2d1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:55.706527 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3737ab50-ae7f-4956-849c-c6f1ebf1a2d1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:55.741199 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3737ab50-ae7f-4956-849c-c6f1ebf1a2d1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050575 Aug 18 14:31:55.741752 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 396/780] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:31:55 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:31:56.031570 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1256f870-0090-4b98-b09f-5f81effce39a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:56.032309 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1256f870-0090-4b98-b09f-5f81effce39a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:56.038815 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1256f870-0090-4b98-b09f-5f81effce39a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:56.039301 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1256f870-0090-4b98-b09f-5f81effce39a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:56.039770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1256f870-0090-4b98-b09f-5f81effce39a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:56.040462 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1256f870-0090-4b98-b09f-5f81effce39a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:56.040920 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1256f870-0090-4b98-b09f-5f81effce39a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:56.041343 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1256f870-0090-4b98-b09f-5f81effce39a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:56.176296 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1256f870-0090-4b98-b09f-5f81effce39a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:56.184582 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1256f870-0090-4b98-b09f-5f81effce39a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:56.186248 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1256f870-0090-4b98-b09f-5f81effce39a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:56.187254 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1256f870-0090-4b98-b09f-5f81effce39a tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.161188 Aug 18 14:31:56.199878 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 385/781] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:56 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:56.616742 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9c6e255d-d7be-4d81-a0db-53c67d9e4bc6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:56.617305 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9c6e255d-d7be-4d81-a0db-53c67d9e4bc6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:56.624790 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c6e255d-d7be-4d81-a0db-53c67d9e4bc6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:56.625277 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c6e255d-d7be-4d81-a0db-53c67d9e4bc6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:56.625714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c6e255d-d7be-4d81-a0db-53c67d9e4bc6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:56.626422 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c6e255d-d7be-4d81-a0db-53c67d9e4bc6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:56.626875 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c6e255d-d7be-4d81-a0db-53c67d9e4bc6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:56.627304 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c6e255d-d7be-4d81-a0db-53c67d9e4bc6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:56.753560 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-74f6ac5e-bced-4222-8443-5a1971b8d984 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:56.756973 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-74f6ac5e-bced-4222-8443-5a1971b8d984 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:56.762994 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74f6ac5e-bced-4222-8443-5a1971b8d984 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:56.763604 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74f6ac5e-bced-4222-8443-5a1971b8d984 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:56.764043 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74f6ac5e-bced-4222-8443-5a1971b8d984 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:56.764732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74f6ac5e-bced-4222-8443-5a1971b8d984 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:56.765179 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74f6ac5e-bced-4222-8443-5a1971b8d984 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:56.765598 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74f6ac5e-bced-4222-8443-5a1971b8d984 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:56.772264 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9c6e255d-d7be-4d81-a0db-53c67d9e4bc6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:56.780557 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9c6e255d-d7be-4d81-a0db-53c67d9e4bc6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.168380 Aug 18 14:31:56.781126 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 397/782] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:56 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:56.799333 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-74f6ac5e-bced-4222-8443-5a1971b8d984 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049614 Aug 18 14:31:56.799995 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 386/783] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:31:56 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:31:57.211669 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-98898e01-724f-4989-983f-4a26037a6555 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:57.212273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-98898e01-724f-4989-983f-4a26037a6555 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:57.218606 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98898e01-724f-4989-983f-4a26037a6555 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:57.219082 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98898e01-724f-4989-983f-4a26037a6555 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:57.219554 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98898e01-724f-4989-983f-4a26037a6555 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:57.220234 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98898e01-724f-4989-983f-4a26037a6555 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:57.220685 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98898e01-724f-4989-983f-4a26037a6555 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:57.221105 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98898e01-724f-4989-983f-4a26037a6555 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:57.349437 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-98898e01-724f-4989-983f-4a26037a6555 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:57.357749 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-98898e01-724f-4989-983f-4a26037a6555 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:57.359252 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-98898e01-724f-4989-983f-4a26037a6555 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:57.360438 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-98898e01-724f-4989-983f-4a26037a6555 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.152760 Aug 18 14:31:57.360998 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 398/784] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:57 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:57.801678 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-437820b3-c3ca-4a4b-8177-62ab6a7d3630 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:57.802988 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-437820b3-c3ca-4a4b-8177-62ab6a7d3630 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:57.809922 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-437820b3-c3ca-4a4b-8177-62ab6a7d3630 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:57.810412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-437820b3-c3ca-4a4b-8177-62ab6a7d3630 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:57.811012 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-437820b3-c3ca-4a4b-8177-62ab6a7d3630 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:57.811692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-437820b3-c3ca-4a4b-8177-62ab6a7d3630 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:57.812283 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-437820b3-c3ca-4a4b-8177-62ab6a7d3630 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:57.812655 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-437820b3-c3ca-4a4b-8177-62ab6a7d3630 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:57.819977 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3b60c127-2e22-4ec5-98a7-cb5af8e6df3f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:57.822254 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3b60c127-2e22-4ec5-98a7-cb5af8e6df3f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:57.828729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b60c127-2e22-4ec5-98a7-cb5af8e6df3f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:57.829215 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b60c127-2e22-4ec5-98a7-cb5af8e6df3f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:57.829659 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b60c127-2e22-4ec5-98a7-cb5af8e6df3f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:57.830349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b60c127-2e22-4ec5-98a7-cb5af8e6df3f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:57.830803 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b60c127-2e22-4ec5-98a7-cb5af8e6df3f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:57.831246 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b60c127-2e22-4ec5-98a7-cb5af8e6df3f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:57.862427 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3b60c127-2e22-4ec5-98a7-cb5af8e6df3f tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050109 Aug 18 14:31:57.863111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 399/785] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:31:57 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:31:57.960040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-437820b3-c3ca-4a4b-8177-62ab6a7d3630 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:57.968465 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-437820b3-c3ca-4a4b-8177-62ab6a7d3630 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1758 microversion: 2.1 time: 0.170598 Aug 18 14:31:57.969037 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 387/786] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:57 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:58.206341 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-135c2e53-dd29-4555-87d7-483185d3d511 req-b69ec9f1-9c40-4109-8955-8bd73a0f4fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "910c9fdb-a6d3-4e60-843e-9e65d037ea71", "name": "network-vif-plugged", "status": "completed", "tag": "7ce6f5b2-32fa-4a9b-b50f-f6c24b537da8"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:31:58.218138 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-135c2e53-dd29-4555-87d7-483185d3d511 req-b69ec9f1-9c40-4109-8955-8bd73a0f4fe2 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:58.218982 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-135c2e53-dd29-4555-87d7-483185d3d511 req-b69ec9f1-9c40-4109-8955-8bd73a0f4fe2 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:58.219439 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-135c2e53-dd29-4555-87d7-483185d3d511 req-b69ec9f1-9c40-4109-8955-8bd73a0f4fe2 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:58.230718 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-135c2e53-dd29-4555-87d7-483185d3d511 req-b69ec9f1-9c40-4109-8955-8bd73a0f4fe2 service nova] Creating event network-vif-plugged:7ce6f5b2-32fa-4a9b-b50f-f6c24b537da8 for instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 on hv-cinder-85220 Aug 18 14:31:58.235961 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-135c2e53-dd29-4555-87d7-483185d3d511 req-b69ec9f1-9c40-4109-8955-8bd73a0f4fe2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033159 Aug 18 14:31:58.236905 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 400/787] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:31:58.383771 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-127ae77e-cb40-4b51-9719-c56f66b9bbf9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:58.384419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-127ae77e-cb40-4b51-9719-c56f66b9bbf9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:58.390344 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-127ae77e-cb40-4b51-9719-c56f66b9bbf9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:58.390835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-127ae77e-cb40-4b51-9719-c56f66b9bbf9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:58.391271 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-127ae77e-cb40-4b51-9719-c56f66b9bbf9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:58.392125 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-127ae77e-cb40-4b51-9719-c56f66b9bbf9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:58.392583 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-127ae77e-cb40-4b51-9719-c56f66b9bbf9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:58.393015 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-127ae77e-cb40-4b51-9719-c56f66b9bbf9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:58.524729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-127ae77e-cb40-4b51-9719-c56f66b9bbf9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:58.532739 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-127ae77e-cb40-4b51-9719-c56f66b9bbf9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:58.534219 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-127ae77e-cb40-4b51-9719-c56f66b9bbf9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:58.535410 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-127ae77e-cb40-4b51-9719-c56f66b9bbf9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.156196 Aug 18 14:31:58.535975 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 388/788] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:58 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:31:58.875185 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0c31cd57-6a01-4957-9bea-00586a95f7ea tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:58.877464 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0c31cd57-6a01-4957-9bea-00586a95f7ea tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:58.884927 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c31cd57-6a01-4957-9bea-00586a95f7ea tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:58.885415 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c31cd57-6a01-4957-9bea-00586a95f7ea tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:58.885846 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c31cd57-6a01-4957-9bea-00586a95f7ea tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:58.886538 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c31cd57-6a01-4957-9bea-00586a95f7ea tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:58.886984 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c31cd57-6a01-4957-9bea-00586a95f7ea tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:58.887426 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c31cd57-6a01-4957-9bea-00586a95f7ea tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:58.918010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0c31cd57-6a01-4957-9bea-00586a95f7ea tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047509 Aug 18 14:31:58.918566 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 401/789] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:31:58 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:31:58.989644 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cf099774-bccc-4a4a-9394-8c04f7cf7863 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:58.990279 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cf099774-bccc-4a4a-9394-8c04f7cf7863 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:58.997832 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf099774-bccc-4a4a-9394-8c04f7cf7863 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:58.998310 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf099774-bccc-4a4a-9394-8c04f7cf7863 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:58.998741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf099774-bccc-4a4a-9394-8c04f7cf7863 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:58.999443 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf099774-bccc-4a4a-9394-8c04f7cf7863 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:58.999893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf099774-bccc-4a4a-9394-8c04f7cf7863 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:59.000314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf099774-bccc-4a4a-9394-8c04f7cf7863 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:59.146420 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cf099774-bccc-4a4a-9394-8c04f7cf7863 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:59.155025 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cf099774-bccc-4a4a-9394-8c04f7cf7863 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1761 microversion: 2.1 time: 0.169222 Aug 18 14:31:59.155622 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 389/790] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:31:58 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1761 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:31:59.558932 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-14b56976-d9af-4f7b-8348-4b59fd45e6cd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:59.559570 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-14b56976-d9af-4f7b-8348-4b59fd45e6cd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:59.565510 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14b56976-d9af-4f7b-8348-4b59fd45e6cd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:59.565996 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14b56976-d9af-4f7b-8348-4b59fd45e6cd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:59.566434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14b56976-d9af-4f7b-8348-4b59fd45e6cd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:59.567119 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14b56976-d9af-4f7b-8348-4b59fd45e6cd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:59.567606 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14b56976-d9af-4f7b-8348-4b59fd45e6cd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:59.568033 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14b56976-d9af-4f7b-8348-4b59fd45e6cd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:59.699131 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-14b56976-d9af-4f7b-8348-4b59fd45e6cd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:59.707175 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-14b56976-d9af-4f7b-8348-4b59fd45e6cd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:59.708697 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-14b56976-d9af-4f7b-8348-4b59fd45e6cd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:31:59.710273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-14b56976-d9af-4f7b-8348-4b59fd45e6cd tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.154944 Aug 18 14:31:59.710782 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 402/791] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:31:59 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 14:31:59.930732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0b93e2ba-98eb-4243-9246-bbedde726c37 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:31:59.932890 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0b93e2ba-98eb-4243-9246-bbedde726c37 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:31:59.938857 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b93e2ba-98eb-4243-9246-bbedde726c37 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:59.939342 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b93e2ba-98eb-4243-9246-bbedde726c37 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:59.939813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b93e2ba-98eb-4243-9246-bbedde726c37 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:59.940499 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b93e2ba-98eb-4243-9246-bbedde726c37 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:31:59.940953 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b93e2ba-98eb-4243-9246-bbedde726c37 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:31:59.941376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b93e2ba-98eb-4243-9246-bbedde726c37 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:31:59.969700 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0b93e2ba-98eb-4243-9246-bbedde726c37 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043496 Aug 18 14:31:59.970271 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 390/792] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:31:59 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:32:00.734373 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-040e8389-0f7f-4622-a0b8-e2662c8c3add tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:00.734911 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-040e8389-0f7f-4622-a0b8-e2662c8c3add tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:00.742590 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-040e8389-0f7f-4622-a0b8-e2662c8c3add tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:00.743072 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-040e8389-0f7f-4622-a0b8-e2662c8c3add tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:00.743532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-040e8389-0f7f-4622-a0b8-e2662c8c3add tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:00.744228 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-040e8389-0f7f-4622-a0b8-e2662c8c3add tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:00.744679 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-040e8389-0f7f-4622-a0b8-e2662c8c3add tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:00.745097 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-040e8389-0f7f-4622-a0b8-e2662c8c3add tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:00.875860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-040e8389-0f7f-4622-a0b8-e2662c8c3add tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:00.884278 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-040e8389-0f7f-4622-a0b8-e2662c8c3add tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:00.885762 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-040e8389-0f7f-4622-a0b8-e2662c8c3add tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:00.886911 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-040e8389-0f7f-4622-a0b8-e2662c8c3add tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1730 microversion: 2.20 time: 0.156779 Aug 18 14:32:00.887488 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 403/793] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:32:00 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:32:00.982990 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ff8a7a7b-82b4-4390-864d-1486cea66abf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:00.985477 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ff8a7a7b-82b4-4390-864d-1486cea66abf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:00.992349 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff8a7a7b-82b4-4390-864d-1486cea66abf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:00.992838 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff8a7a7b-82b4-4390-864d-1486cea66abf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:00.993276 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff8a7a7b-82b4-4390-864d-1486cea66abf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:00.994150 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff8a7a7b-82b4-4390-864d-1486cea66abf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:00.994602 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff8a7a7b-82b4-4390-864d-1486cea66abf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:00.995030 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff8a7a7b-82b4-4390-864d-1486cea66abf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:01.029593 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ff8a7a7b-82b4-4390-864d-1486cea66abf tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049755 Aug 18 14:32:01.030274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 391/794] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:32:00 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:32:01.611272 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7322b99c-0c76-4021-a01f-5e4bd8384b32 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:32:01.618063 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7322b99c-0c76-4021-a01f-5e4bd8384b32 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:01.618548 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7322b99c-0c76-4021-a01f-5e4bd8384b32 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:01.618986 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7322b99c-0c76-4021-a01f-5e4bd8384b32 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:01.679013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7322b99c-0c76-4021-a01f-5e4bd8384b32 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Going to try to stop instance {{(pid=120538) force_stop /opt/stack/nova/nova/compute/api.py:2752}} Aug 18 14:32:01.723442 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7322b99c-0c76-4021-a01f-5e4bd8384b32 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "POST /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/action" status: 202 len: 0 microversion: 2.1 time: 0.115882 Aug 18 14:32:01.724091 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 404/795] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:32:01 2022] POST /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:32:01.732201 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-908fefed-0b9c-4928-b7d5-6d458c93077c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:01.732826 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-908fefed-0b9c-4928-b7d5-6d458c93077c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:01.739047 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-908fefed-0b9c-4928-b7d5-6d458c93077c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:01.739569 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-908fefed-0b9c-4928-b7d5-6d458c93077c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:01.740198 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-908fefed-0b9c-4928-b7d5-6d458c93077c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:01.741423 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-908fefed-0b9c-4928-b7d5-6d458c93077c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:01.741927 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-908fefed-0b9c-4928-b7d5-6d458c93077c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:01.742519 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-908fefed-0b9c-4928-b7d5-6d458c93077c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:01.882173 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-908fefed-0b9c-4928-b7d5-6d458c93077c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:01.891560 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-908fefed-0b9c-4928-b7d5-6d458c93077c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1722 microversion: 2.1 time: 0.163167 Aug 18 14:32:01.892122 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 392/796] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:01 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:01.910905 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b5cebe09-1776-47bc-96f5-bcc890129d9b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:01.911661 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b5cebe09-1776-47bc-96f5-bcc890129d9b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:01.918365 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5cebe09-1776-47bc-96f5-bcc890129d9b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:01.918844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5cebe09-1776-47bc-96f5-bcc890129d9b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:01.919310 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5cebe09-1776-47bc-96f5-bcc890129d9b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:01.920087 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5cebe09-1776-47bc-96f5-bcc890129d9b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:01.920543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5cebe09-1776-47bc-96f5-bcc890129d9b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:01.920971 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5cebe09-1776-47bc-96f5-bcc890129d9b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:02.043750 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f52c53b2-2509-4e74-99dc-1c6ab348dd86 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:02.045979 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f52c53b2-2509-4e74-99dc-1c6ab348dd86 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:02.052349 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f52c53b2-2509-4e74-99dc-1c6ab348dd86 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:02.052841 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f52c53b2-2509-4e74-99dc-1c6ab348dd86 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:02.052951 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b5cebe09-1776-47bc-96f5-bcc890129d9b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:02.053935 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f52c53b2-2509-4e74-99dc-1c6ab348dd86 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:02.054777 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f52c53b2-2509-4e74-99dc-1c6ab348dd86 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:02.055242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f52c53b2-2509-4e74-99dc-1c6ab348dd86 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:02.055712 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f52c53b2-2509-4e74-99dc-1c6ab348dd86 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:02.061660 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b5cebe09-1776-47bc-96f5-bcc890129d9b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:02.063165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b5cebe09-1776-47bc-96f5-bcc890129d9b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:02.064356 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b5cebe09-1776-47bc-96f5-bcc890129d9b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1717 microversion: 2.20 time: 0.158150 Aug 18 14:32:02.064928 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 405/797] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:32:01 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:32:02.084997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f52c53b2-2509-4e74-99dc-1c6ab348dd86 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044934 Aug 18 14:32:02.085557 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 393/798] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:32:02 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:32:02.146559 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6ee1b959-1488-4f51-8986-d369ec2ffe46 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:02.147083 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6ee1b959-1488-4f51-8986-d369ec2ffe46 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:02.153064 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ee1b959-1488-4f51-8986-d369ec2ffe46 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:02.153545 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ee1b959-1488-4f51-8986-d369ec2ffe46 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:02.153983 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ee1b959-1488-4f51-8986-d369ec2ffe46 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:02.154665 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ee1b959-1488-4f51-8986-d369ec2ffe46 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:02.155122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ee1b959-1488-4f51-8986-d369ec2ffe46 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:02.155580 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ee1b959-1488-4f51-8986-d369ec2ffe46 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:02.181155 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6ee1b959-1488-4f51-8986-d369ec2ffe46 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:32:02.257876 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6ee1b959-1488-4f51-8986-d369ec2ffe46 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 204 len: 0 microversion: 2.1 time: 0.114934 Aug 18 14:32:02.258490 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 406/799] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:32:02 2022] DELETE /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:32:02.267145 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5bfcdcff-79ec-4a27-a865-b670f0fd81b1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:02.267781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5bfcdcff-79ec-4a27-a865-b670f0fd81b1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:02.274745 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bfcdcff-79ec-4a27-a865-b670f0fd81b1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:02.275226 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bfcdcff-79ec-4a27-a865-b670f0fd81b1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:02.275719 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bfcdcff-79ec-4a27-a865-b670f0fd81b1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:02.276386 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bfcdcff-79ec-4a27-a865-b670f0fd81b1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:02.276834 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bfcdcff-79ec-4a27-a865-b670f0fd81b1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:02.277255 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bfcdcff-79ec-4a27-a865-b670f0fd81b1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:02.410300 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5bfcdcff-79ec-4a27-a865-b670f0fd81b1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:02.418678 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5bfcdcff-79ec-4a27-a865-b670f0fd81b1 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1681 microversion: 2.1 time: 0.155563 Aug 18 14:32:02.419240 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 394/800] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:02 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:32:02.914188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3182d857-0a6e-4e64-9d00-4645dfd0ae08 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:02.914880 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3182d857-0a6e-4e64-9d00-4645dfd0ae08 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:02.921239 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3182d857-0a6e-4e64-9d00-4645dfd0ae08 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:02.921715 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3182d857-0a6e-4e64-9d00-4645dfd0ae08 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:02.922145 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3182d857-0a6e-4e64-9d00-4645dfd0ae08 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:02.922824 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3182d857-0a6e-4e64-9d00-4645dfd0ae08 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:02.923275 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3182d857-0a6e-4e64-9d00-4645dfd0ae08 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:02.923720 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3182d857-0a6e-4e64-9d00-4645dfd0ae08 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:03.202942 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3182d857-0a6e-4e64-9d00-4645dfd0ae08 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:03.211088 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3182d857-0a6e-4e64-9d00-4645dfd0ae08 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1722 microversion: 2.1 time: 0.301694 Aug 18 14:32:03.211689 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 407/801] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:02 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:03.439806 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e5aa811c-7093-4702-9e7d-6915b8e79922 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:03.440423 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e5aa811c-7093-4702-9e7d-6915b8e79922 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:03.446934 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5aa811c-7093-4702-9e7d-6915b8e79922 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:03.447452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5aa811c-7093-4702-9e7d-6915b8e79922 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:03.447891 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5aa811c-7093-4702-9e7d-6915b8e79922 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:03.448579 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5aa811c-7093-4702-9e7d-6915b8e79922 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:03.449032 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5aa811c-7093-4702-9e7d-6915b8e79922 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:03.449458 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5aa811c-7093-4702-9e7d-6915b8e79922 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:03.580752 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e5aa811c-7093-4702-9e7d-6915b8e79922 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:03.588509 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e5aa811c-7093-4702-9e7d-6915b8e79922 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1681 microversion: 2.1 time: 0.152533 Aug 18 14:32:03.589077 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 395/802] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:03 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:04.232439 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6c38e239-7282-421f-ac85-53a7290480c7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:04.233322 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6c38e239-7282-421f-ac85-53a7290480c7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:04.240831 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c38e239-7282-421f-ac85-53a7290480c7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:04.241514 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c38e239-7282-421f-ac85-53a7290480c7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:04.241953 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c38e239-7282-421f-ac85-53a7290480c7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:04.242652 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c38e239-7282-421f-ac85-53a7290480c7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:04.243118 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c38e239-7282-421f-ac85-53a7290480c7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:04.243576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c38e239-7282-421f-ac85-53a7290480c7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:04.433053 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6c38e239-7282-421f-ac85-53a7290480c7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:04.436851 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:32:04.443465 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6c38e239-7282-421f-ac85-53a7290480c7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1722 microversion: 2.1 time: 0.214875 Aug 18 14:32:04.444545 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 408/803] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:04 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:04.610026 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7764e876-4eae-45aa-9577-87c16a4e9c41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:04.610643 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7764e876-4eae-45aa-9577-87c16a4e9c41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:04.617651 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7764e876-4eae-45aa-9577-87c16a4e9c41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:04.618134 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7764e876-4eae-45aa-9577-87c16a4e9c41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:04.618571 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7764e876-4eae-45aa-9577-87c16a4e9c41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:04.619300 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7764e876-4eae-45aa-9577-87c16a4e9c41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:04.619789 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7764e876-4eae-45aa-9577-87c16a4e9c41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:04.620213 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7764e876-4eae-45aa-9577-87c16a4e9c41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:04.685477 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7764e876-4eae-45aa-9577-87c16a4e9c41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5972d1e96fa04d52983ac6f201d7772c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e7d0fb80204fc99b0e3ad583a9eedf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:04.693416 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7764e876-4eae-45aa-9577-87c16a4e9c41 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 200 len: 1613 microversion: 2.1 time: 0.087157 Aug 18 14:32:04.695018 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 396/804] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:04 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 1613 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:04.991862 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-f9e271b5-37f3-49b2-829a-9f8ef3471249 req-c70aabae-654a-462c-8cc1-6cdfc2b76be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86d8b41d-49fe-4ffd-9896-33f4a20a437b", "name": "network-vif-deleted", "tag": "e29f52c7-443d-4909-adc8-b988297386bb"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:32:05.001981 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-f9e271b5-37f3-49b2-829a-9f8ef3471249 req-c70aabae-654a-462c-8cc1-6cdfc2b76be3 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:05.002459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-f9e271b5-37f3-49b2-829a-9f8ef3471249 req-c70aabae-654a-462c-8cc1-6cdfc2b76be3 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:05.002897 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-f9e271b5-37f3-49b2-829a-9f8ef3471249 req-c70aabae-654a-462c-8cc1-6cdfc2b76be3 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:05.014863 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-f9e271b5-37f3-49b2-829a-9f8ef3471249 req-c70aabae-654a-462c-8cc1-6cdfc2b76be3 service nova] Creating event network-vif-deleted:e29f52c7-443d-4909-adc8-b988297386bb for instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b on hv-cinder-85220 Aug 18 14:32:05.020004 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-f9e271b5-37f3-49b2-829a-9f8ef3471249 req-c70aabae-654a-462c-8cc1-6cdfc2b76be3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032976 Aug 18 14:32:05.020727 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 409/805] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:32:05.466592 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9ed28a27-a46d-4db2-95e4-070407b071c9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:05.467378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9ed28a27-a46d-4db2-95e4-070407b071c9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:05.473577 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ed28a27-a46d-4db2-95e4-070407b071c9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:05.474203 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ed28a27-a46d-4db2-95e4-070407b071c9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:05.475625 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ed28a27-a46d-4db2-95e4-070407b071c9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:05.477046 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ed28a27-a46d-4db2-95e4-070407b071c9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:05.477744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ed28a27-a46d-4db2-95e4-070407b071c9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:05.478351 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ed28a27-a46d-4db2-95e4-070407b071c9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:05.616986 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9ed28a27-a46d-4db2-95e4-070407b071c9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:05.627319 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9ed28a27-a46d-4db2-95e4-070407b071c9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1722 microversion: 2.1 time: 0.164806 Aug 18 14:32:05.627961 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 397/806] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:05 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:05.717544 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-078eb1bd-ff04-49f7-b912-ffb41c3d9fd9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:05.718283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-078eb1bd-ff04-49f7-b912-ffb41c3d9fd9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:05.724340 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-078eb1bd-ff04-49f7-b912-ffb41c3d9fd9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:05.725366 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-078eb1bd-ff04-49f7-b912-ffb41c3d9fd9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:05.725818 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-078eb1bd-ff04-49f7-b912-ffb41c3d9fd9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:05.726523 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-078eb1bd-ff04-49f7-b912-ffb41c3d9fd9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:05.726980 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-078eb1bd-ff04-49f7-b912-ffb41c3d9fd9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:05.727534 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-078eb1bd-ff04-49f7-b912-ffb41c3d9fd9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:05.741840 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-078eb1bd-ff04-49f7-b912-ffb41c3d9fd9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-078eb1bd-ff04-49f7-b912-ffb41c3d9fd9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b HTTP/1.1 Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:32:05.743516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:32:05.745111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:05.745111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:05.745111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:05.745111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:05.745111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:05.745111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:32:05.745111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:32:05.745111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:32:05.745111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:05.745111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:32:05.745111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:05.745111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '86d8b41d-49fe-4ffd-9896-33f4a20a437b'} Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:05.745940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:05.747257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:05.748553 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-078eb1bd-ff04-49f7-b912-ffb41c3d9fd9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 404 to user: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:05.748553 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-078eb1bd-ff04-49f7-b912-ffb41c3d9fd9 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 404 len: 111 microversion: 2.1 time: 0.032462 Aug 18 14:32:05.748553 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 410/807] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:05 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:32:05.754878 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cd1b8c52-c338-4f92-b927-9c7b9c6ba14d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '.version_select at 0x7fb6229963a0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:05.775416 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cd1b8c52-c338-4f92-b927-9c7b9c6ba14d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-228649418" status: 202 len: 0 microversion: 2.1 time: 0.025040 Aug 18 14:32:05.776015 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 398/808] 10.222.0.39 () {58 vars in 1218 bytes} [Thu Aug 18 14:32:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-228649418 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:32:06.649228 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-514d1da7-895b-4792-8a9f-fba81d105f75 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:06.649767 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-514d1da7-895b-4792-8a9f-fba81d105f75 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:06.655757 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-514d1da7-895b-4792-8a9f-fba81d105f75 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:06.656244 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-514d1da7-895b-4792-8a9f-fba81d105f75 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:06.656687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-514d1da7-895b-4792-8a9f-fba81d105f75 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:06.657391 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-514d1da7-895b-4792-8a9f-fba81d105f75 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:06.657864 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-514d1da7-895b-4792-8a9f-fba81d105f75 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:06.658297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-514d1da7-895b-4792-8a9f-fba81d105f75 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:06.797780 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-514d1da7-895b-4792-8a9f-fba81d105f75 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:06.805974 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-514d1da7-895b-4792-8a9f-fba81d105f75 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1722 microversion: 2.1 time: 0.160752 Aug 18 14:32:06.806527 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 411/809] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:06 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:07.552709 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c0d4cbd3-9cf5-4dec-8a9b-649098cbccf0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:07.553838 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c0d4cbd3-9cf5-4dec-8a9b-649098cbccf0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:07.559677 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0d4cbd3-9cf5-4dec-8a9b-649098cbccf0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:07.560156 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0d4cbd3-9cf5-4dec-8a9b-649098cbccf0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:07.560595 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0d4cbd3-9cf5-4dec-8a9b-649098cbccf0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:07.561272 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0d4cbd3-9cf5-4dec-8a9b-649098cbccf0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:07.561721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0d4cbd3-9cf5-4dec-8a9b-649098cbccf0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:07.562139 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0d4cbd3-9cf5-4dec-8a9b-649098cbccf0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:07.577418 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-c0d4cbd3-9cf5-4dec-8a9b-649098cbccf0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c0d4cbd3-9cf5-4dec-8a9b-649098cbccf0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b HTTP/1.1 Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:32:07.579040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:32:07.580635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:07.580635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:07.580635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:07.580635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:07.580635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:07.580635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:32:07.580635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:32:07.580635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:32:07.580635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:07.580635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:32:07.580635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:07.580635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '86d8b41d-49fe-4ffd-9896-33f4a20a437b'} Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:07.581535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:07.583045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:07.584643 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c0d4cbd3-9cf5-4dec-8a9b-649098cbccf0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 404 to user: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:07.584643 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c0d4cbd3-9cf5-4dec-8a9b-649098cbccf0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 404 len: 111 microversion: 2.1 time: 0.032005 Aug 18 14:32:07.584643 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 399/810] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:32:07 2022] DELETE /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:32:07.589105 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-68a1cdb7-468f-4f5e-957a-b739af94633d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:07.589720 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-68a1cdb7-468f-4f5e-957a-b739af94633d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: 86d8b41d-49fe-4ffd-9896-33f4a20a437b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:07.595926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68a1cdb7-468f-4f5e-957a-b739af94633d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:07.596402 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68a1cdb7-468f-4f5e-957a-b739af94633d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:07.596834 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68a1cdb7-468f-4f5e-957a-b739af94633d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:07.597523 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68a1cdb7-468f-4f5e-957a-b739af94633d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:07.597971 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68a1cdb7-468f-4f5e-957a-b739af94633d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:07.598391 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68a1cdb7-468f-4f5e-957a-b739af94633d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:07.611698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-68a1cdb7-468f-4f5e-957a-b739af94633d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-68a1cdb7-468f-4f5e-957a-b739af94633d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b HTTP/1.1 Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:32:07.613188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:32:07.614716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:07.614716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:07.614716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:07.614716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:07.614716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:07.614716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:32:07.614716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:32:07.614716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:32:07.614716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:07.614716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:32:07.614716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:07.614716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '86d8b41d-49fe-4ffd-9896-33f4a20a437b'} Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:07.616167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. Aug 18 14:32:07.617732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:07.618994 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-68a1cdb7-468f-4f5e-957a-b739af94633d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 404 to user: Instance 86d8b41d-49fe-4ffd-9896-33f4a20a437b could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:07.618994 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-68a1cdb7-468f-4f5e-957a-b739af94633d tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b" status: 404 len: 111 microversion: 2.1 time: 0.029428 Aug 18 14:32:07.618994 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 412/811] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:07 2022] GET /compute/v2.1/servers/86d8b41d-49fe-4ffd-9896-33f4a20a437b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:32:07.826607 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a50a59d8-20d1-4b48-be66-6bd79c373b0c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:07.827275 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a50a59d8-20d1-4b48-be66-6bd79c373b0c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:07.833532 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a50a59d8-20d1-4b48-be66-6bd79c373b0c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:07.834072 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a50a59d8-20d1-4b48-be66-6bd79c373b0c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:07.834786 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a50a59d8-20d1-4b48-be66-6bd79c373b0c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:07.835626 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a50a59d8-20d1-4b48-be66-6bd79c373b0c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:07.836131 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a50a59d8-20d1-4b48-be66-6bd79c373b0c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:07.836582 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a50a59d8-20d1-4b48-be66-6bd79c373b0c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:07.974261 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a50a59d8-20d1-4b48-be66-6bd79c373b0c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:07.983191 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a50a59d8-20d1-4b48-be66-6bd79c373b0c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1722 microversion: 2.1 time: 0.160708 Aug 18 14:32:07.983795 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 400/812] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:07 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:32:08.756052 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-08cc717d-7bd0-42d8-9207-2b2985d3c30b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:08.756553 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-08cc717d-7bd0-42d8-9207-2b2985d3c30b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:08.762911 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08cc717d-7bd0-42d8-9207-2b2985d3c30b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:08.763433 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08cc717d-7bd0-42d8-9207-2b2985d3c30b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:08.763875 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08cc717d-7bd0-42d8-9207-2b2985d3c30b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:08.764571 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08cc717d-7bd0-42d8-9207-2b2985d3c30b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:08.765028 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08cc717d-7bd0-42d8-9207-2b2985d3c30b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:08.765459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08cc717d-7bd0-42d8-9207-2b2985d3c30b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:08.778510 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-08cc717d-7bd0-42d8-9207-2b2985d3c30b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-08cc717d-7bd0-42d8-9207-2b2985d3c30b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 HTTP/1.1 Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:32:08.780062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:32:08.781617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:08.781617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:08.781617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:08.781617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:08.781617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:08.781617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:32:08.781617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:32:08.781617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:32:08.781617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:08.781617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:32:08.781617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:32:08.781617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': 'ee35547b-560b-4510-a182-aae686f38082'} Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:08.782636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:32:08.784151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.785853 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-08cc717d-7bd0-42d8-9207-2b2985d3c30b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 404 to user: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:08.785853 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-08cc717d-7bd0-42d8-9207-2b2985d3c30b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 404 len: 111 microversion: 2.1 time: 0.029213 Aug 18 14:32:08.785853 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 413/813] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:32:08 2022] DELETE /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:32:08.790379 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d0bab1e3-6f9e-4cdf-aac9-c9da9387858a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:08.790991 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d0bab1e3-6f9e-4cdf-aac9-c9da9387858a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ee35547b-560b-4510-a182-aae686f38082] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:08.797402 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0bab1e3-6f9e-4cdf-aac9-c9da9387858a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:08.797881 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0bab1e3-6f9e-4cdf-aac9-c9da9387858a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:08.798319 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0bab1e3-6f9e-4cdf-aac9-c9da9387858a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:08.799002 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0bab1e3-6f9e-4cdf-aac9-c9da9387858a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:08.799489 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0bab1e3-6f9e-4cdf-aac9-c9da9387858a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:08.799912 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0bab1e3-6f9e-4cdf-aac9-c9da9387858a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:08.813511 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-d0bab1e3-6f9e-4cdf-aac9-c9da9387858a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d0bab1e3-6f9e-4cdf-aac9-c9da9387858a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 HTTP/1.1 Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:32:08.814983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:32:08.816574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:08.816574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:08.816574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:08.816574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:08.816574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:08.816574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:32:08.816574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:32:08.816574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:32:08.816574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:08.816574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:32:08.816574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:32:08.816574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': 'ee35547b-560b-4510-a182-aae686f38082'} Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:08.817453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. Aug 18 14:32:08.819061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.820384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d0bab1e3-6f9e-4cdf-aac9-c9da9387858a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 404 to user: Instance ee35547b-560b-4510-a182-aae686f38082 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:08.820384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d0bab1e3-6f9e-4cdf-aac9-c9da9387858a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082" status: 404 len: 111 microversion: 2.1 time: 0.030599 Aug 18 14:32:08.820384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 401/814] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:08 2022] GET /compute/v2.1/servers/ee35547b-560b-4510-a182-aae686f38082 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 14:32:08.824685 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b480f3ec-f569-4355-82ea-506e92c89d7a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:08.825185 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b480f3ec-f569-4355-82ea-506e92c89d7a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:08.831090 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b480f3ec-f569-4355-82ea-506e92c89d7a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:08.831615 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b480f3ec-f569-4355-82ea-506e92c89d7a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:08.832049 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b480f3ec-f569-4355-82ea-506e92c89d7a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:08.832736 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b480f3ec-f569-4355-82ea-506e92c89d7a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:08.833189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b480f3ec-f569-4355-82ea-506e92c89d7a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:08.833615 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b480f3ec-f569-4355-82ea-506e92c89d7a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:08.846958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-b480f3ec-f569-4355-82ea-506e92c89d7a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b480f3ec-f569-4355-82ea-506e92c89d7a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 HTTP/1.1 Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:32:08.848502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:32:08.850542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:08.850542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:08.850542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:08.850542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:08.850542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:08.850542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:32:08.850542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:32:08.850542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:32:08.850542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:08.850542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:32:08.850542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:32:08.850542 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': 'b7926083-e26a-4fa9-bd23-73d13c892da4'} Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:08.851681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:32:08.853159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.854692 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b480f3ec-f569-4355-82ea-506e92c89d7a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 404 to user: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:08.854692 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b480f3ec-f569-4355-82ea-506e92c89d7a tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 404 len: 111 microversion: 2.1 time: 0.028931 Aug 18 14:32:08.854692 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 414/815] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:32:08 2022] DELETE /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:32:08.858750 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-503fd370-5c2b-4377-b83b-fabf66729596 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:08.859359 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-503fd370-5c2b-4377-b83b-fabf66729596 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: b7926083-e26a-4fa9-bd23-73d13c892da4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:08.865359 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-503fd370-5c2b-4377-b83b-fabf66729596 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:08.866514 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-503fd370-5c2b-4377-b83b-fabf66729596 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:08.866939 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-503fd370-5c2b-4377-b83b-fabf66729596 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:08.867728 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-503fd370-5c2b-4377-b83b-fabf66729596 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:08.868171 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-503fd370-5c2b-4377-b83b-fabf66729596 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:08.868592 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-503fd370-5c2b-4377-b83b-fabf66729596 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:08.871335 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:32:08.883676 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-503fd370-5c2b-4377-b83b-fabf66729596 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-503fd370-5c2b-4377-b83b-fabf66729596 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 HTTP/1.1 Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:32:08.885159 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:32:08.886801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:08.886801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:08.886801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:08.886801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:08.886801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:08.886801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:32:08.886801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:32:08.886801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:32:08.886801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:08.886801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:32:08.886801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:32:08.886801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': 'b7926083-e26a-4fa9-bd23-73d13c892da4'} Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:08.887781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. Aug 18 14:32:08.889390 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:08.890960 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-503fd370-5c2b-4377-b83b-fabf66729596 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 404 to user: Instance b7926083-e26a-4fa9-bd23-73d13c892da4 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:08.890960 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-503fd370-5c2b-4377-b83b-fabf66729596 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4" status: 404 len: 111 microversion: 2.1 time: 0.031607 Aug 18 14:32:08.890960 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 402/816] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:08 2022] GET /compute/v2.1/servers/b7926083-e26a-4fa9-bd23-73d13c892da4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:32:09.003901 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-be2f3a87-72a0-4b69-b334-e1f629cb6b86 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:09.004513 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-be2f3a87-72a0-4b69-b334-e1f629cb6b86 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:09.011276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be2f3a87-72a0-4b69-b334-e1f629cb6b86 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:09.011791 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be2f3a87-72a0-4b69-b334-e1f629cb6b86 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:09.012225 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be2f3a87-72a0-4b69-b334-e1f629cb6b86 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:09.012938 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be2f3a87-72a0-4b69-b334-e1f629cb6b86 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:09.013385 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be2f3a87-72a0-4b69-b334-e1f629cb6b86 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:09.013808 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be2f3a87-72a0-4b69-b334-e1f629cb6b86 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:09.152660 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-be2f3a87-72a0-4b69-b334-e1f629cb6b86 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:09.161036 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-be2f3a87-72a0-4b69-b334-e1f629cb6b86 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1722 microversion: 2.1 time: 0.160880 Aug 18 14:32:09.161594 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 415/817] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:08 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:10.026065 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-779c2511-f822-46cb-9b5d-2f6b4c0dd45b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:10.026589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-779c2511-f822-46cb-9b5d-2f6b4c0dd45b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:10.033101 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-779c2511-f822-46cb-9b5d-2f6b4c0dd45b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:10.033575 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-779c2511-f822-46cb-9b5d-2f6b4c0dd45b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:10.034005 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-779c2511-f822-46cb-9b5d-2f6b4c0dd45b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:10.034715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-779c2511-f822-46cb-9b5d-2f6b4c0dd45b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:10.035161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-779c2511-f822-46cb-9b5d-2f6b4c0dd45b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:10.035610 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-779c2511-f822-46cb-9b5d-2f6b4c0dd45b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:10.049662 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-779c2511-f822-46cb-9b5d-2f6b4c0dd45b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-779c2511-f822-46cb-9b5d-2f6b4c0dd45b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f HTTP/1.1 Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:32:10.051165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:32:10.052550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:10.052550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:10.052550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:10.052550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:10.052550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:10.052550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:32:10.052550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:32:10.052550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:32:10.052550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:10.052550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:32:10.052550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:32:10.052550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': 'ed05a0ad-3aad-4113-b8b3-8daa97e04f2f'} Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:10.053378 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:32:10.054601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:10.055847 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-779c2511-f822-46cb-9b5d-2f6b4c0dd45b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 404 to user: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:10.055847 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-779c2511-f822-46cb-9b5d-2f6b4c0dd45b tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 404 len: 111 microversion: 2.1 time: 0.031004 Aug 18 14:32:10.055847 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 403/818] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:32:10 2022] DELETE /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:32:10.061297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6a4abf84-cf7b-4636-bcc3-db869cae09a0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:10.061918 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6a4abf84-cf7b-4636-bcc3-db869cae09a0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] [instance: ed05a0ad-3aad-4113-b8b3-8daa97e04f2f] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:10.068257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a4abf84-cf7b-4636-bcc3-db869cae09a0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:10.068882 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a4abf84-cf7b-4636-bcc3-db869cae09a0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:10.069326 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a4abf84-cf7b-4636-bcc3-db869cae09a0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:10.070017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a4abf84-cf7b-4636-bcc3-db869cae09a0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:10.070472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a4abf84-cf7b-4636-bcc3-db869cae09a0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:10.070900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a4abf84-cf7b-4636-bcc3-db869cae09a0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:10.084605 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-6a4abf84-cf7b-4636-bcc3-db869cae09a0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] HTTP exception thrown: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6a4abf84-cf7b-4636-bcc3-db869cae09a0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Request method failure captured: Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f HTTP/1.1 Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kvEzpk8vgwmgbnwP0YHfKWoap0RTUJvuF21vcdrs3RWoQYuHLchOh1XdCaJpv8tS_MPj9njuF9OcHdT7-oYGuGcdug09l8a0LvyFXlJmmjis3Z73SkrMH0E2ZgbuKr5pEsRXCSUU1GfQDuTSaN8xmes2PVtNn1A9XGfmi1HMemQTeA Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:32:10.086111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:32:10.087722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31e7d0fb80204fc99b0e3ad583a9eedf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:10.087722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:10.087722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 31e7d0fb80204fc99b0e3ad583a9eedf Aug 18 14:32:10.087722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-327049058 Aug 18 14:32:10.087722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:10.087722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:32:10.087722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:32:10.087722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 5972d1e96fa04d52983ac6f201d7772c Aug 18 14:32:10.087722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeNegativeTest-327049058-project Aug 18 14:32:10.087722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:32:10.087722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:32:10.087722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': 'ed05a0ad-3aad-4113-b8b3-8daa97e04f2f'} Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:10.088543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. Aug 18 14:32:10.090401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:10.091747 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6a4abf84-cf7b-4636-bcc3-db869cae09a0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] Returning 404 to user: Instance ed05a0ad-3aad-4113-b8b3-8daa97e04f2f could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:10.091747 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6a4abf84-cf7b-4636-bcc3-db869cae09a0 tempest-AttachVolumeNegativeTest-327049058 tempest-AttachVolumeNegativeTest-327049058-project] 10.222.0.39 "GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f" status: 404 len: 111 microversion: 2.1 time: 0.030024 Aug 18 14:32:10.091747 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 416/819] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:10 2022] GET /compute/v2.1/servers/ed05a0ad-3aad-4113-b8b3-8daa97e04f2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:32:10.181947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fc0b5308-49d5-4641-9b99-e23582a62172 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:10.182562 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fc0b5308-49d5-4641-9b99-e23582a62172 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:10.188670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc0b5308-49d5-4641-9b99-e23582a62172 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:10.189156 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc0b5308-49d5-4641-9b99-e23582a62172 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:10.189593 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc0b5308-49d5-4641-9b99-e23582a62172 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:10.190288 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc0b5308-49d5-4641-9b99-e23582a62172 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:10.190733 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc0b5308-49d5-4641-9b99-e23582a62172 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:10.191195 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc0b5308-49d5-4641-9b99-e23582a62172 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:10.661481 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fc0b5308-49d5-4641-9b99-e23582a62172 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:10.669886 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fc0b5308-49d5-4641-9b99-e23582a62172 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1722 microversion: 2.1 time: 0.491777 Aug 18 14:32:10.670546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 404/820] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:10 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1722 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:11.691782 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e8dd2851-bf4c-4ced-8df3-da5e2fa59d68 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:11.692405 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e8dd2851-bf4c-4ced-8df3-da5e2fa59d68 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:11.700266 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8dd2851-bf4c-4ced-8df3-da5e2fa59d68 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:11.700794 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8dd2851-bf4c-4ced-8df3-da5e2fa59d68 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:11.701239 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8dd2851-bf4c-4ced-8df3-da5e2fa59d68 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:11.702208 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8dd2851-bf4c-4ced-8df3-da5e2fa59d68 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:11.702656 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8dd2851-bf4c-4ced-8df3-da5e2fa59d68 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:11.703087 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8dd2851-bf4c-4ced-8df3-da5e2fa59d68 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:11.838845 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e8dd2851-bf4c-4ced-8df3-da5e2fa59d68 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:11.847579 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e8dd2851-bf4c-4ced-8df3-da5e2fa59d68 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1722 microversion: 2.1 time: 0.159698 Aug 18 14:32:11.848353 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 417/821] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:11 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:12.868977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b5752c96-19df-4eba-bcda-28c624a1e140 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:12.869593 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b5752c96-19df-4eba-bcda-28c624a1e140 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:12.876934 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5752c96-19df-4eba-bcda-28c624a1e140 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:12.877429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5752c96-19df-4eba-bcda-28c624a1e140 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:12.879845 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5752c96-19df-4eba-bcda-28c624a1e140 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:12.881441 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5752c96-19df-4eba-bcda-28c624a1e140 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:12.882148 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5752c96-19df-4eba-bcda-28c624a1e140 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:12.882752 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5752c96-19df-4eba-bcda-28c624a1e140 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:13.116575 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b5752c96-19df-4eba-bcda-28c624a1e140 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:13.133300 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b5752c96-19df-4eba-bcda-28c624a1e140 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1722 microversion: 2.1 time: 0.268660 Aug 18 14:32:13.133793 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 405/822] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:12 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:14.153761 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-29bfe4b9-468f-45dc-a357-599504a1ea4f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:14.154392 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-29bfe4b9-468f-45dc-a357-599504a1ea4f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:14.160783 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29bfe4b9-468f-45dc-a357-599504a1ea4f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:14.161273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29bfe4b9-468f-45dc-a357-599504a1ea4f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:14.161711 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29bfe4b9-468f-45dc-a357-599504a1ea4f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:14.162936 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29bfe4b9-468f-45dc-a357-599504a1ea4f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:14.163405 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29bfe4b9-468f-45dc-a357-599504a1ea4f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:14.163842 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29bfe4b9-468f-45dc-a357-599504a1ea4f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:14.302977 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-29bfe4b9-468f-45dc-a357-599504a1ea4f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:14.311222 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-29bfe4b9-468f-45dc-a357-599504a1ea4f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1722 microversion: 2.1 time: 0.161213 Aug 18 14:32:14.311884 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 418/823] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:14 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:15.332466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3ef90c88-ec9f-471d-bfd1-0f7d09af84e0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:15.333079 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3ef90c88-ec9f-471d-bfd1-0f7d09af84e0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:15.340075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ef90c88-ec9f-471d-bfd1-0f7d09af84e0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:15.340630 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ef90c88-ec9f-471d-bfd1-0f7d09af84e0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:15.341131 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ef90c88-ec9f-471d-bfd1-0f7d09af84e0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:15.341904 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ef90c88-ec9f-471d-bfd1-0f7d09af84e0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:15.342425 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ef90c88-ec9f-471d-bfd1-0f7d09af84e0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:15.343068 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ef90c88-ec9f-471d-bfd1-0f7d09af84e0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:15.497639 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3ef90c88-ec9f-471d-bfd1-0f7d09af84e0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:15.514296 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3ef90c88-ec9f-471d-bfd1-0f7d09af84e0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1722 microversion: 2.1 time: 0.185636 Aug 18 14:32:15.519471 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 406/824] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:15 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:16.538166 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d0cd70a8-42de-4f77-891d-53bdb805d469 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:16.539067 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d0cd70a8-42de-4f77-891d-53bdb805d469 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:16.545385 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0cd70a8-42de-4f77-891d-53bdb805d469 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:16.545863 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0cd70a8-42de-4f77-891d-53bdb805d469 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:16.546294 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0cd70a8-42de-4f77-891d-53bdb805d469 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:16.546982 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0cd70a8-42de-4f77-891d-53bdb805d469 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:16.547465 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0cd70a8-42de-4f77-891d-53bdb805d469 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:16.547889 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0cd70a8-42de-4f77-891d-53bdb805d469 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:16.686635 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d0cd70a8-42de-4f77-891d-53bdb805d469 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:16.696091 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d0cd70a8-42de-4f77-891d-53bdb805d469 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1722 microversion: 2.1 time: 0.162061 Aug 18 14:32:16.696658 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 419/825] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:16 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:17.717392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fff4cab5-c2ba-487a-95af-9c327e59ff7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:17.718019 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fff4cab5-c2ba-487a-95af-9c327e59ff7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:17.724670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fff4cab5-c2ba-487a-95af-9c327e59ff7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:17.725349 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fff4cab5-c2ba-487a-95af-9c327e59ff7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:17.725809 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fff4cab5-c2ba-487a-95af-9c327e59ff7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:17.726494 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fff4cab5-c2ba-487a-95af-9c327e59ff7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:17.726944 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fff4cab5-c2ba-487a-95af-9c327e59ff7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:17.727386 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fff4cab5-c2ba-487a-95af-9c327e59ff7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:17.859245 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fff4cab5-c2ba-487a-95af-9c327e59ff7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:17.868177 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fff4cab5-c2ba-487a-95af-9c327e59ff7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1699 microversion: 2.1 time: 0.154835 Aug 18 14:32:17.868840 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 407/826] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:17 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:17.888976 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-025a3f33-2871-4193-9605-04ab354f6866 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:32:17.895693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-025a3f33-2871-4193-9605-04ab354f6866 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:17.896340 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-025a3f33-2871-4193-9605-04ab354f6866 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:17.896807 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-025a3f33-2871-4193-9605-04ab354f6866 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:17.919207 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-025a3f33-2871-4193-9605-04ab354f6866 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Going to try to start instance {{(pid=120538) start /opt/stack/nova/nova/compute/api.py:2775}} Aug 18 14:32:17.959940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-025a3f33-2871-4193-9605-04ab354f6866 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "POST /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/action" status: 202 len: 0 microversion: 2.1 time: 0.074575 Aug 18 14:32:17.960592 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 420/827] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:32:17 2022] POST /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:32:17.969004 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-49544ac9-1295-407e-aa61-e153ad1143c2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:17.969556 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-49544ac9-1295-407e-aa61-e153ad1143c2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:17.975994 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49544ac9-1295-407e-aa61-e153ad1143c2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:17.976473 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49544ac9-1295-407e-aa61-e153ad1143c2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:17.977106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49544ac9-1295-407e-aa61-e153ad1143c2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:17.977809 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49544ac9-1295-407e-aa61-e153ad1143c2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:17.978265 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49544ac9-1295-407e-aa61-e153ad1143c2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:17.978691 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49544ac9-1295-407e-aa61-e153ad1143c2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:18.116229 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-49544ac9-1295-407e-aa61-e153ad1143c2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:18.124360 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-49544ac9-1295-407e-aa61-e153ad1143c2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1708 microversion: 2.1 time: 0.159521 Aug 18 14:32:18.125032 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 408/828] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:17 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:19.146893 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9f9662aa-d3ff-489e-b178-565d2fb83f92 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:19.147627 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9f9662aa-d3ff-489e-b178-565d2fb83f92 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:19.153676 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f9662aa-d3ff-489e-b178-565d2fb83f92 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:19.154158 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f9662aa-d3ff-489e-b178-565d2fb83f92 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:19.154589 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f9662aa-d3ff-489e-b178-565d2fb83f92 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:19.155457 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f9662aa-d3ff-489e-b178-565d2fb83f92 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:19.156030 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f9662aa-d3ff-489e-b178-565d2fb83f92 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:19.156455 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f9662aa-d3ff-489e-b178-565d2fb83f92 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:19.288911 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9f9662aa-d3ff-489e-b178-565d2fb83f92 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:19.297277 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9f9662aa-d3ff-489e-b178-565d2fb83f92 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1708 microversion: 2.1 time: 0.155386 Aug 18 14:32:19.297925 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 421/829] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:19 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1708 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:20.319185 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8af757b3-50bd-41f4-9d43-c11cba7214f4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:20.319808 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8af757b3-50bd-41f4-9d43-c11cba7214f4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:20.326196 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8af757b3-50bd-41f4-9d43-c11cba7214f4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:20.326679 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8af757b3-50bd-41f4-9d43-c11cba7214f4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:20.327117 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8af757b3-50bd-41f4-9d43-c11cba7214f4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:20.327842 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8af757b3-50bd-41f4-9d43-c11cba7214f4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:20.328300 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8af757b3-50bd-41f4-9d43-c11cba7214f4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:20.328727 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8af757b3-50bd-41f4-9d43-c11cba7214f4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:20.457692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8af757b3-50bd-41f4-9d43-c11cba7214f4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:20.466500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8af757b3-50bd-41f4-9d43-c11cba7214f4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1708 microversion: 2.1 time: 0.152060 Aug 18 14:32:20.467005 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 409/830] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:20 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1708 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:21.487853 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5d19da92-3714-497e-8edb-3ce316dee7ab tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:21.488392 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5d19da92-3714-497e-8edb-3ce316dee7ab tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:21.495935 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d19da92-3714-497e-8edb-3ce316dee7ab tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:21.496431 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d19da92-3714-497e-8edb-3ce316dee7ab tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:21.496876 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d19da92-3714-497e-8edb-3ce316dee7ab tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:21.497580 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d19da92-3714-497e-8edb-3ce316dee7ab tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:21.498035 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d19da92-3714-497e-8edb-3ce316dee7ab tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:21.498472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d19da92-3714-497e-8edb-3ce316dee7ab tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:21.628997 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5d19da92-3714-497e-8edb-3ce316dee7ab tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:21.637161 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5d19da92-3714-497e-8edb-3ce316dee7ab tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1708 microversion: 2.1 time: 0.153317 Aug 18 14:32:21.637718 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 422/831] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:21 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:22.658025 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2bffde97-7ea0-43e1-a323-e58cb9d07327 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:22.658623 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2bffde97-7ea0-43e1-a323-e58cb9d07327 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:22.665360 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bffde97-7ea0-43e1-a323-e58cb9d07327 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:22.665838 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bffde97-7ea0-43e1-a323-e58cb9d07327 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:22.666268 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bffde97-7ea0-43e1-a323-e58cb9d07327 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:22.666949 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bffde97-7ea0-43e1-a323-e58cb9d07327 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:22.667415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bffde97-7ea0-43e1-a323-e58cb9d07327 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:22.667924 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bffde97-7ea0-43e1-a323-e58cb9d07327 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:22.801105 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2bffde97-7ea0-43e1-a323-e58cb9d07327 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:22.809451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2bffde97-7ea0-43e1-a323-e58cb9d07327 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1708 microversion: 2.1 time: 0.155284 Aug 18 14:32:22.810025 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 410/832] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:22 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:23.829996 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cad67f92-645e-4875-9c02-6b510a724c2f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:23.830606 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cad67f92-645e-4875-9c02-6b510a724c2f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:23.837824 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cad67f92-645e-4875-9c02-6b510a724c2f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:23.838297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cad67f92-645e-4875-9c02-6b510a724c2f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:23.838731 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cad67f92-645e-4875-9c02-6b510a724c2f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:23.839430 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cad67f92-645e-4875-9c02-6b510a724c2f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:23.840170 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cad67f92-645e-4875-9c02-6b510a724c2f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:23.840590 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cad67f92-645e-4875-9c02-6b510a724c2f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:23.970418 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cad67f92-645e-4875-9c02-6b510a724c2f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:23.978695 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cad67f92-645e-4875-9c02-6b510a724c2f tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1712 microversion: 2.1 time: 0.152546 Aug 18 14:32:23.979257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 423/833] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:23 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1712 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:48.041812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6431528b-0bb3-464f-9ce9-1ed232321b44 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1047992206"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:32:48.042481 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6431528b-0bb3-464f-9ce9-1ed232321b44 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:48.044583 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:32:48.045306 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=45 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:32:48.051492 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6431528b-0bb3-464f-9ce9-1ed232321b44 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:48.051976 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6431528b-0bb3-464f-9ce9-1ed232321b44 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:48.052412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6431528b-0bb3-464f-9ce9-1ed232321b44 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:48.053098 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6431528b-0bb3-464f-9ce9-1ed232321b44 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:48.053547 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6431528b-0bb3-464f-9ce9-1ed232321b44 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:48.053968 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6431528b-0bb3-464f-9ce9-1ed232321b44 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:48.180049 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.network.security_group_api [None req-6431528b-0bb3-464f-9ce9-1ed232321b44 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Removing security group 95b7d166-082c-4104-adb2-05b5df10f9d5 from port 6a55ee51-1001-4a61-a93a-c6e99dbaa47a Aug 18 14:32:48.490965 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6431528b-0bb3-464f-9ce9-1ed232321b44 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "POST /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/action" status: 202 len: 0 microversion: 2.1 time: 0.453804 Aug 18 14:32:48.492012 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 411/834] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:32:48 2022] POST /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:32:48.501589 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-5b2ea084-1164-4b30-b703-93e6b3019f51 req-e7890f5c-35ca-4c0c-ba9d-9618eb1d02c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f291a369-1330-40f8-b4fc-d6af6b3afa1b", "tag": "6a55ee51-1001-4a61-a93a-c6e99dbaa47a"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:32:48.513383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:32:48.514991 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:32:48.517415 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-5b2ea084-1164-4b30-b703-93e6b3019f51 req-e7890f5c-35ca-4c0c-ba9d-9618eb1d02c3 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:48.518365 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-5b2ea084-1164-4b30-b703-93e6b3019f51 req-e7890f5c-35ca-4c0c-ba9d-9618eb1d02c3 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:48.519025 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-5b2ea084-1164-4b30-b703-93e6b3019f51 req-e7890f5c-35ca-4c0c-ba9d-9618eb1d02c3 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:48.543829 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-5b2ea084-1164-4b30-b703-93e6b3019f51 req-e7890f5c-35ca-4c0c-ba9d-9618eb1d02c3 service nova] Creating event network-changed:6a55ee51-1001-4a61-a93a-c6e99dbaa47a for instance f291a369-1330-40f8-b4fc-d6af6b3afa1b on hv-cinder-85220 Aug 18 14:32:48.550807 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-5b2ea084-1164-4b30-b703-93e6b3019f51 req-e7890f5c-35ca-4c0c-ba9d-9618eb1d02c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053499 Aug 18 14:32:48.551844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 424/835] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:32:49.924375 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-64e12f9f-996d-4f2d-968a-aff766951bd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:49.927246 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-64e12f9f-996d-4f2d-968a-aff766951bd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:49.934996 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64e12f9f-996d-4f2d-968a-aff766951bd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:49.935813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64e12f9f-996d-4f2d-968a-aff766951bd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:49.936483 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64e12f9f-996d-4f2d-968a-aff766951bd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:49.937406 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64e12f9f-996d-4f2d-968a-aff766951bd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:49.938061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64e12f9f-996d-4f2d-968a-aff766951bd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:49.938700 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64e12f9f-996d-4f2d-968a-aff766951bd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:49.979470 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-64e12f9f-996d-4f2d-968a-aff766951bd9 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059618 Aug 18 14:32:49.980133 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 412/836] 10.222.0.39 () {60 vars in 1343 bytes} [Thu Aug 18 14:32:49 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:32:50.030215 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fc4ceb81-c1e2-4fc2-a393-949abb2e98b5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:50.033306 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fc4ceb81-c1e2-4fc2-a393-949abb2e98b5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:50.053270 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc4ceb81-c1e2-4fc2-a393-949abb2e98b5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:50.054208 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc4ceb81-c1e2-4fc2-a393-949abb2e98b5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:50.055070 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc4ceb81-c1e2-4fc2-a393-949abb2e98b5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:50.060035 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f68c0a59-785e-49b9-8f20-ea35c9d95f21 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:50.060932 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f68c0a59-785e-49b9-8f20-ea35c9d95f21 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:50.063070 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc4ceb81-c1e2-4fc2-a393-949abb2e98b5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:50.063840 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc4ceb81-c1e2-4fc2-a393-949abb2e98b5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:50.064367 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc4ceb81-c1e2-4fc2-a393-949abb2e98b5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:50.069301 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f68c0a59-785e-49b9-8f20-ea35c9d95f21 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:50.070362 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f68c0a59-785e-49b9-8f20-ea35c9d95f21 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:50.071070 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f68c0a59-785e-49b9-8f20-ea35c9d95f21 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:50.073035 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f68c0a59-785e-49b9-8f20-ea35c9d95f21 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:50.073948 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f68c0a59-785e-49b9-8f20-ea35c9d95f21 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:50.074746 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f68c0a59-785e-49b9-8f20-ea35c9d95f21 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:50.107563 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f68c0a59-785e-49b9-8f20-ea35c9d95f21 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:32:50.188761 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-fc4ceb81-c1e2-4fc2-a393-949abb2e98b5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lazy-loading 'services' on Instance uuid f291a369-1330-40f8-b4fc-d6af6b3afa1b {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:32:50.215553 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f68c0a59-785e-49b9-8f20-ea35c9d95f21 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "DELETE /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 204 len: 0 microversion: 2.20 time: 0.160585 Aug 18 14:32:50.220661 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 413/837] 10.222.0.39 () {60 vars in 1280 bytes} [Thu Aug 18 14:32:50 2022] DELETE /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 14:32:50.229270 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-29225c5c-bd84-4cca-82a4-02d5ff193faa tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:50.230027 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-29225c5c-bd84-4cca-82a4-02d5ff193faa tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:50.238981 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29225c5c-bd84-4cca-82a4-02d5ff193faa tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:50.239219 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29225c5c-bd84-4cca-82a4-02d5ff193faa tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:50.239536 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29225c5c-bd84-4cca-82a4-02d5ff193faa tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:50.240269 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29225c5c-bd84-4cca-82a4-02d5ff193faa tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:50.240716 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29225c5c-bd84-4cca-82a4-02d5ff193faa tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:50.241494 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29225c5c-bd84-4cca-82a4-02d5ff193faa tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:50.280656 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fc4ceb81-c1e2-4fc2-a393-949abb2e98b5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/os-volume_attachments/11a75190-bf96-42df-bce4-c36f6a832d63" status: 202 len: 0 microversion: 2.1 time: 0.272897 Aug 18 14:32:50.282041 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 425/838] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Aug 18 14:32:50 2022] DELETE /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/os-volume_attachments/11a75190-bf96-42df-bce4-c36f6a832d63 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:32:50.290717 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c687d89e-1d43-4e10-a2bf-9f76acb05135 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:50.293637 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c687d89e-1d43-4e10-a2bf-9f76acb05135 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:50.300959 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c687d89e-1d43-4e10-a2bf-9f76acb05135 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:50.301759 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c687d89e-1d43-4e10-a2bf-9f76acb05135 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:50.302223 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c687d89e-1d43-4e10-a2bf-9f76acb05135 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:50.302932 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c687d89e-1d43-4e10-a2bf-9f76acb05135 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:50.303496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c687d89e-1d43-4e10-a2bf-9f76acb05135 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:50.304173 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c687d89e-1d43-4e10-a2bf-9f76acb05135 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:50.341025 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c687d89e-1d43-4e10-a2bf-9f76acb05135 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055116 Aug 18 14:32:50.341759 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 426/839] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:32:50 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:32:50.394055 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-29225c5c-bd84-4cca-82a4-02d5ff193faa tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:50.403269 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-29225c5c-bd84-4cca-82a4-02d5ff193faa tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:50.404806 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-29225c5c-bd84-4cca-82a4-02d5ff193faa tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:50.405962 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-29225c5c-bd84-4cca-82a4-02d5ff193faa tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.183657 Aug 18 14:32:50.406535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 414/840] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:32:50 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:32:50.567445 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-3dd3d9a0-d13f-4980-9dd9-ef21acd5d878 req-89753e34-bd0b-45a4-a6d6-ea54016431c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f291a369-1330-40f8-b4fc-d6af6b3afa1b", "tag": "6a55ee51-1001-4a61-a93a-c6e99dbaa47a"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:32:50.577523 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-3dd3d9a0-d13f-4980-9dd9-ef21acd5d878 req-89753e34-bd0b-45a4-a6d6-ea54016431c5 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:50.578005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-3dd3d9a0-d13f-4980-9dd9-ef21acd5d878 req-89753e34-bd0b-45a4-a6d6-ea54016431c5 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:50.578469 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-3dd3d9a0-d13f-4980-9dd9-ef21acd5d878 req-89753e34-bd0b-45a4-a6d6-ea54016431c5 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:50.590838 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-3dd3d9a0-d13f-4980-9dd9-ef21acd5d878 req-89753e34-bd0b-45a4-a6d6-ea54016431c5 service nova] Creating event network-changed:6a55ee51-1001-4a61-a93a-c6e99dbaa47a for instance f291a369-1330-40f8-b4fc-d6af6b3afa1b on hv-cinder-85220 Aug 18 14:32:50.596007 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-3dd3d9a0-d13f-4980-9dd9-ef21acd5d878 req-89753e34-bd0b-45a4-a6d6-ea54016431c5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032195 Aug 18 14:32:50.596606 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 427/841] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:32:51.354104 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-097a9962-942e-4171-b01c-d74cdcf00b46 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:51.356359 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-097a9962-942e-4171-b01c-d74cdcf00b46 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:51.362729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-097a9962-942e-4171-b01c-d74cdcf00b46 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:51.363215 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-097a9962-942e-4171-b01c-d74cdcf00b46 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:51.363682 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-097a9962-942e-4171-b01c-d74cdcf00b46 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:51.364381 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-097a9962-942e-4171-b01c-d74cdcf00b46 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:51.364834 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-097a9962-942e-4171-b01c-d74cdcf00b46 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:51.365260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-097a9962-942e-4171-b01c-d74cdcf00b46 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:51.396418 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-097a9962-942e-4171-b01c-d74cdcf00b46 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046781 Aug 18 14:32:51.396981 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 415/842] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:32:51 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:32:51.430102 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8cf8764f-9319-40d3-bc1b-4bc32620cfa2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:51.431394 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8cf8764f-9319-40d3-bc1b-4bc32620cfa2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:51.437511 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cf8764f-9319-40d3-bc1b-4bc32620cfa2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:51.437989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cf8764f-9319-40d3-bc1b-4bc32620cfa2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:51.438423 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cf8764f-9319-40d3-bc1b-4bc32620cfa2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:51.439117 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cf8764f-9319-40d3-bc1b-4bc32620cfa2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:51.439601 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cf8764f-9319-40d3-bc1b-4bc32620cfa2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:51.440026 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cf8764f-9319-40d3-bc1b-4bc32620cfa2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:51.619979 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8cf8764f-9319-40d3-bc1b-4bc32620cfa2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:51.633987 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8cf8764f-9319-40d3-bc1b-4bc32620cfa2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:51.636048 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8cf8764f-9319-40d3-bc1b-4bc32620cfa2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:51.637394 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8cf8764f-9319-40d3-bc1b-4bc32620cfa2 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.211863 Aug 18 14:32:51.638158 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 428/843] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:32:51 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:32:52.408706 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b1338931-2527-4564-b4d0-ee1da0894723 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:52.410844 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b1338931-2527-4564-b4d0-ee1da0894723 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:52.418278 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1338931-2527-4564-b4d0-ee1da0894723 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:52.418765 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1338931-2527-4564-b4d0-ee1da0894723 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:52.419200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1338931-2527-4564-b4d0-ee1da0894723 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:52.419929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1338931-2527-4564-b4d0-ee1da0894723 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:52.420381 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1338931-2527-4564-b4d0-ee1da0894723 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:52.420806 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1338931-2527-4564-b4d0-ee1da0894723 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:52.450732 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b1338931-2527-4564-b4d0-ee1da0894723 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045845 Aug 18 14:32:52.451214 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 416/844] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:32:52 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:32:52.462475 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-36ceccdb-a017-48aa-8d27-c9d9bc538ea2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:52.463126 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-36ceccdb-a017-48aa-8d27-c9d9bc538ea2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:52.469821 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36ceccdb-a017-48aa-8d27-c9d9bc538ea2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:52.470312 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36ceccdb-a017-48aa-8d27-c9d9bc538ea2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:52.470759 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36ceccdb-a017-48aa-8d27-c9d9bc538ea2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:52.471739 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36ceccdb-a017-48aa-8d27-c9d9bc538ea2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:52.472213 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36ceccdb-a017-48aa-8d27-c9d9bc538ea2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:52.472644 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36ceccdb-a017-48aa-8d27-c9d9bc538ea2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:52.553753 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-36ceccdb-a017-48aa-8d27-c9d9bc538ea2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] HTTP exception thrown: Instance f291a369-1330-40f8-b4fc-d6af6b3afa1b is not attached to volume 11a75190-bf96-42df-bce4-c36f6a832d63 Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-36ceccdb-a017-48aa-8d27-c9d9bc538ea2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Request method failure captured: Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/os-volume_attachments/11a75190-bf96-42df-bce4-c36f6a832d63 HTTP/1.1 Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kzuZQKKGIjpSCmzLJOsU1Moz5GOvMTsDihVn0oAvOkjFdku8HD-pB-cCoCXl5PCfU-6bkgVgJREmJA3Hqx3MQurQQjWVMOWOyDKNKxS7gcGaaPO40Anct-aB0A2xDnSEY6XLdtdov2m2-0WJ-PqFKhtoQtMFyMNVbO4KOJAr2GG3MI Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 7d21898f611b41e68cf9eb1b2f3edf8e Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-TestMinimumBasicScenario-409201551 Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:32:52.556732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:32:52.558537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d21898f611b41e68cf9eb1b2f3edf8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7d21898f611b41e68cf9eb1b2f3edf8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d21898f611b41e68cf9eb1b2f3edf8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7d21898f611b41e68cf9eb1b2f3edf8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:52.558537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-TestMinimumBasicScenario-409201551 Aug 18 14:32:52.558537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 7d21898f611b41e68cf9eb1b2f3edf8e Aug 18 14:32:52.558537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-TestMinimumBasicScenario-409201551 Aug 18 14:32:52.558537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-TestMinimumBasicScenario-409201551-project Aug 18 14:32:52.558537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:32:52.558537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:32:52.558537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: b7454072c7944ae0b442885ac7660a90 Aug 18 14:32:52.558537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-TestMinimumBasicScenario-409201551-project Aug 18 14:32:52.558537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:32:52.558537 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance f291a369-1330-40f8-b4fc-d6af6b3afa1b is not attached to volume 11a75190-bf96-42df-bce4-c36f6a832d63 Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'server_id': 'f291a369-1330-40f8-b4fc-d6af6b3afa1b', 'id': '11a75190-bf96-42df-bce4-c36f6a832d63'} Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 11a75190-bf96-42df-bce4-c36f6a832d63. Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:52.559333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f291a369-1330-40f8-b4fc-d6af6b3afa1b is not attached to volume 11a75190-bf96-42df-bce4-c36f6a832d63 Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f291a369-1330-40f8-b4fc-d6af6b3afa1b is not attached to volume 11a75190-bf96-42df-bce4-c36f6a832d63 Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:52.560687 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-36ceccdb-a017-48aa-8d27-c9d9bc538ea2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Returning 404 to user: Instance f291a369-1330-40f8-b4fc-d6af6b3afa1b is not attached to volume 11a75190-bf96-42df-bce4-c36f6a832d63 {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:52.561656 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-36ceccdb-a017-48aa-8d27-c9d9bc538ea2 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/os-volume_attachments/11a75190-bf96-42df-bce4-c36f6a832d63" status: 404 len: 154 microversion: 2.1 time: 0.100446 Aug 18 14:32:52.561656 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 429/845] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Aug 18 14:32:52 2022] DELETE /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b/os-volume_attachments/11a75190-bf96-42df-bce4-c36f6a832d63 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:32:52.663546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4021838d-fa63-4e28-84b3-b3475fddc036 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:52.664856 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4021838d-fa63-4e28-84b3-b3475fddc036 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:52.671582 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4021838d-fa63-4e28-84b3-b3475fddc036 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:52.672414 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4021838d-fa63-4e28-84b3-b3475fddc036 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:52.673064 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4021838d-fa63-4e28-84b3-b3475fddc036 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:52.673989 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4021838d-fa63-4e28-84b3-b3475fddc036 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:52.674640 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4021838d-fa63-4e28-84b3-b3475fddc036 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:52.675299 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4021838d-fa63-4e28-84b3-b3475fddc036 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:52.825264 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4021838d-fa63-4e28-84b3-b3475fddc036 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:52.835714 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4021838d-fa63-4e28-84b3-b3475fddc036 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:52.838121 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4021838d-fa63-4e28-84b3-b3475fddc036 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8a3d1fa830b540adbe68ef7cf7f08004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25458a67a8b4394b0ebca1482524608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:52.840280 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4021838d-fa63-4e28-84b3-b3475fddc036 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 200 len: 1723 microversion: 2.20 time: 0.181441 Aug 18 14:32:52.841277 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 417/846] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:32:52 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 14:32:53.081266 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-494126b9-398a-41e4-904b-88664f80af03 req-f8d4606a-6b04-40af-98a2-207b7c17896a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "910c9fdb-a6d3-4e60-843e-9e65d037ea71", "name": "network-vif-deleted", "tag": "7ce6f5b2-32fa-4a9b-b50f-f6c24b537da8"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:32:53.091876 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-494126b9-398a-41e4-904b-88664f80af03 req-f8d4606a-6b04-40af-98a2-207b7c17896a service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:53.093011 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-494126b9-398a-41e4-904b-88664f80af03 req-f8d4606a-6b04-40af-98a2-207b7c17896a service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:53.093715 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-494126b9-398a-41e4-904b-88664f80af03 req-f8d4606a-6b04-40af-98a2-207b7c17896a service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:53.106815 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-494126b9-398a-41e4-904b-88664f80af03 req-f8d4606a-6b04-40af-98a2-207b7c17896a service nova] Creating event network-vif-deleted:7ce6f5b2-32fa-4a9b-b50f-f6c24b537da8 for instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 on hv-cinder-85220 Aug 18 14:32:53.112010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-494126b9-398a-41e4-904b-88664f80af03 req-f8d4606a-6b04-40af-98a2-207b7c17896a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035236 Aug 18 14:32:53.112706 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 430/847] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:32:53.725493 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6e1d8b9e-9173-48dd-b189-8e10674d557c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:53.725980 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6e1d8b9e-9173-48dd-b189-8e10674d557c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:53.733004 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e1d8b9e-9173-48dd-b189-8e10674d557c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:53.733501 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e1d8b9e-9173-48dd-b189-8e10674d557c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:53.733940 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e1d8b9e-9173-48dd-b189-8e10674d557c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:53.734646 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e1d8b9e-9173-48dd-b189-8e10674d557c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:53.735099 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e1d8b9e-9173-48dd-b189-8e10674d557c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:53.735755 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e1d8b9e-9173-48dd-b189-8e10674d557c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:53.763729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6e1d8b9e-9173-48dd-b189-8e10674d557c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:32:53.851782 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6e1d8b9e-9173-48dd-b189-8e10674d557c tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 204 len: 0 microversion: 2.1 time: 0.129245 Aug 18 14:32:53.853394 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 418/848] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:32:53 2022] DELETE /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:32:53.862940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6dc79c22-d96f-4e06-bf67-51cf87aa1fc5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:53.864274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a0ee3ff0-9611-4c06-b4e5-5dc25bd7966c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:53.864682 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6dc79c22-d96f-4e06-bf67-51cf87aa1fc5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:53.865185 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a0ee3ff0-9611-4c06-b4e5-5dc25bd7966c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:53.876304 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0ee3ff0-9611-4c06-b4e5-5dc25bd7966c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:53.876521 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0ee3ff0-9611-4c06-b4e5-5dc25bd7966c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:53.877048 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0ee3ff0-9611-4c06-b4e5-5dc25bd7966c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:53.877903 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0ee3ff0-9611-4c06-b4e5-5dc25bd7966c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:53.878520 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0ee3ff0-9611-4c06-b4e5-5dc25bd7966c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:53.878809 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dc79c22-d96f-4e06-bf67-51cf87aa1fc5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:53.878937 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0ee3ff0-9611-4c06-b4e5-5dc25bd7966c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:53.879873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dc79c22-d96f-4e06-bf67-51cf87aa1fc5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:53.880553 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dc79c22-d96f-4e06-bf67-51cf87aa1fc5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:53.881473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dc79c22-d96f-4e06-bf67-51cf87aa1fc5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:53.882145 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dc79c22-d96f-4e06-bf67-51cf87aa1fc5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:53.883017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dc79c22-d96f-4e06-bf67-51cf87aa1fc5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:53.896619 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-a0ee3ff0-9611-4c06-b4e5-5dc25bd7966c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] HTTP exception thrown: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a0ee3ff0-9611-4c06-b4e5-5dc25bd7966c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Request method failure captured: Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 HTTP/1.1 Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kwUAIi1Wx1P_DjMBSJZmX7v2mJQ7rKoW_jNqpNVpZHhpqVoWG8AVUC7p67lFAx7hP76UlJyW0_uRF6gZJNpYnGAONNb3bYpdfnBFD6nOBS_HUxllybxwU0keCu9xu8kvzRLcZTI-iOamdcTZly1cFLuI57jJlGqNweUjUQxMfSHWgk Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: e25458a67a8b4394b0ebca1482524608 Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:32:53.898365 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:32:53.899893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e25458a67a8b4394b0ebca1482524608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:53.899893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:53.899893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: e25458a67a8b4394b0ebca1482524608 Aug 18 14:32:53.899893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:53.899893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeShelveTestJSON-1050663749-project Aug 18 14:32:53.899893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:32:53.899893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:32:53.899893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 8a3d1fa830b540adbe68ef7cf7f08004 Aug 18 14:32:53.899893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1050663749-project Aug 18 14:32:53.899893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:32:53.899893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:53.899893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '910c9fdb-a6d3-4e60-843e-9e65d037ea71'} Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:53.900823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:53.902080 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:53.903212 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a0ee3ff0-9611-4c06-b4e5-5dc25bd7966c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Returning 404 to user: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:53.903212 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a0ee3ff0-9611-4c06-b4e5-5dc25bd7966c tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 404 len: 111 microversion: 2.20 time: 0.040967 Aug 18 14:32:53.903212 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 419/849] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:32:53 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:32:53.912375 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a187c0f0-c13f-4d1f-8b6b-449f10dace68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '.version_select at 0x7fb621e913a0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:53.939134 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a187c0f0-c13f-4d1f-8b6b-449f10dace68 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164660227" status: 204 len: 0 microversion: 2.20 time: 0.030572 Aug 18 14:32:53.939785 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 420/850] 10.222.0.39 () {60 vars in 1262 bytes} [Thu Aug 18 14:32:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164660227 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 14:32:54.047539 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6dc79c22-d96f-4e06-bf67-51cf87aa1fc5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:54.057677 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6dc79c22-d96f-4e06-bf67-51cf87aa1fc5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1555 microversion: 2.1 time: 0.199679 Aug 18 14:32:54.058707 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 431/851] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:53 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1555 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:55.079571 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3c5d876a-27fe-4cf2-a486-8af1c4b21cb6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:55.080190 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3c5d876a-27fe-4cf2-a486-8af1c4b21cb6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:55.087038 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c5d876a-27fe-4cf2-a486-8af1c4b21cb6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:55.087580 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c5d876a-27fe-4cf2-a486-8af1c4b21cb6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:55.088026 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c5d876a-27fe-4cf2-a486-8af1c4b21cb6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:55.088722 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c5d876a-27fe-4cf2-a486-8af1c4b21cb6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:55.089450 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c5d876a-27fe-4cf2-a486-8af1c4b21cb6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:55.089872 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c5d876a-27fe-4cf2-a486-8af1c4b21cb6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:55.225098 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3c5d876a-27fe-4cf2-a486-8af1c4b21cb6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:55.234254 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3c5d876a-27fe-4cf2-a486-8af1c4b21cb6 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1555 microversion: 2.1 time: 0.159139 Aug 18 14:32:55.234802 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 421/852] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:55 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:55.839401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c6e55b70-03e4-488c-b46f-9dae22df2d29 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:55.839800 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c6e55b70-03e4-488c-b46f-9dae22df2d29 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:55.845919 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6e55b70-03e4-488c-b46f-9dae22df2d29 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:55.846404 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6e55b70-03e4-488c-b46f-9dae22df2d29 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:55.846836 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6e55b70-03e4-488c-b46f-9dae22df2d29 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:55.847701 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6e55b70-03e4-488c-b46f-9dae22df2d29 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:55.848184 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6e55b70-03e4-488c-b46f-9dae22df2d29 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:55.848609 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6e55b70-03e4-488c-b46f-9dae22df2d29 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:55.863804 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-c6e55b70-03e4-488c-b46f-9dae22df2d29 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] HTTP exception thrown: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c6e55b70-03e4-488c-b46f-9dae22df2d29 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Request method failure captured: Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 HTTP/1.1 Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kwUAIi1Wx1P_DjMBSJZmX7v2mJQ7rKoW_jNqpNVpZHhpqVoWG8AVUC7p67lFAx7hP76UlJyW0_uRF6gZJNpYnGAONNb3bYpdfnBFD6nOBS_HUxllybxwU0keCu9xu8kvzRLcZTI-iOamdcTZly1cFLuI57jJlGqNweUjUQxMfSHWgk Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: e25458a67a8b4394b0ebca1482524608 Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:32:55.865518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:32:55.866914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e25458a67a8b4394b0ebca1482524608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:55.866914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:55.866914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: e25458a67a8b4394b0ebca1482524608 Aug 18 14:32:55.866914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:55.866914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeShelveTestJSON-1050663749-project Aug 18 14:32:55.866914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:32:55.866914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:32:55.866914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 8a3d1fa830b540adbe68ef7cf7f08004 Aug 18 14:32:55.866914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1050663749-project Aug 18 14:32:55.866914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:32:55.866914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:55.866914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '910c9fdb-a6d3-4e60-843e-9e65d037ea71'} Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:55.868039 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:55.871576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:55.877639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c6e55b70-03e4-488c-b46f-9dae22df2d29 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Returning 404 to user: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:55.877639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c6e55b70-03e4-488c-b46f-9dae22df2d29 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "DELETE /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 404 len: 111 microversion: 2.20 time: 0.038208 Aug 18 14:32:55.879205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0482d10c-1737-4645-9170-01ad7d2de5ff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:55.879570 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0482d10c-1737-4645-9170-01ad7d2de5ff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 910c9fdb-a6d3-4e60-843e-9e65d037ea71] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:55.882718 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 432/853] 10.222.0.39 () {60 vars in 1280 bytes} [Thu Aug 18 14:32:55 2022] DELETE /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:32:55.886488 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0482d10c-1737-4645-9170-01ad7d2de5ff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:55.886984 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0482d10c-1737-4645-9170-01ad7d2de5ff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:55.887439 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0482d10c-1737-4645-9170-01ad7d2de5ff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:55.888150 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0482d10c-1737-4645-9170-01ad7d2de5ff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:55.888766 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0482d10c-1737-4645-9170-01ad7d2de5ff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:55.889009 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0482d10c-1737-4645-9170-01ad7d2de5ff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:55.904729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-0482d10c-1737-4645-9170-01ad7d2de5ff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] HTTP exception thrown: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0482d10c-1737-4645-9170-01ad7d2de5ff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Request method failure captured: Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 HTTP/1.1 Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kwUAIi1Wx1P_DjMBSJZmX7v2mJQ7rKoW_jNqpNVpZHhpqVoWG8AVUC7p67lFAx7hP76UlJyW0_uRF6gZJNpYnGAONNb3bYpdfnBFD6nOBS_HUxllybxwU0keCu9xu8kvzRLcZTI-iOamdcTZly1cFLuI57jJlGqNweUjUQxMfSHWgk Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: e25458a67a8b4394b0ebca1482524608 Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:32:55.906170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:32:55.907692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e25458a67a8b4394b0ebca1482524608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:55.907692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:55.907692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: e25458a67a8b4394b0ebca1482524608 Aug 18 14:32:55.907692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:55.907692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeShelveTestJSON-1050663749-project Aug 18 14:32:55.907692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:32:55.907692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:32:55.907692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 8a3d1fa830b540adbe68ef7cf7f08004 Aug 18 14:32:55.907692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1050663749-project Aug 18 14:32:55.907692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:32:55.907692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:55.907692 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '910c9fdb-a6d3-4e60-843e-9e65d037ea71'} Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:55.908452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. Aug 18 14:32:55.909813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:55.910977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0482d10c-1737-4645-9170-01ad7d2de5ff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Returning 404 to user: Instance 910c9fdb-a6d3-4e60-843e-9e65d037ea71 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:55.910977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0482d10c-1737-4645-9170-01ad7d2de5ff tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71" status: 404 len: 111 microversion: 2.20 time: 0.034508 Aug 18 14:32:55.910977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 422/854] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:32:55 2022] GET /compute/v2.1/servers/910c9fdb-a6d3-4e60-843e-9e65d037ea71 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:32:56.255275 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a916a862-16d6-45b2-9d06-ae77822a92d1 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:56.256277 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a916a862-16d6-45b2-9d06-ae77822a92d1 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:56.265221 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a916a862-16d6-45b2-9d06-ae77822a92d1 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:56.267071 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a916a862-16d6-45b2-9d06-ae77822a92d1 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:56.267785 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a916a862-16d6-45b2-9d06-ae77822a92d1 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:56.268878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a916a862-16d6-45b2-9d06-ae77822a92d1 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:56.270283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a916a862-16d6-45b2-9d06-ae77822a92d1 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:56.270908 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a916a862-16d6-45b2-9d06-ae77822a92d1 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:56.401688 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a916a862-16d6-45b2-9d06-ae77822a92d1 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7454072c7944ae0b442885ac7660a90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d21898f611b41e68cf9eb1b2f3edf8e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:32:56.410875 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a916a862-16d6-45b2-9d06-ae77822a92d1 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 200 len: 1513 microversion: 2.1 time: 0.159472 Aug 18 14:32:56.411470 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 433/855] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:56 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:32:56.413618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-3bbe645e-d1ae-4be0-a3a5-3671e63bdaa7 req-bad99204-e1a7-4075-a0ed-aceaadc93492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f291a369-1330-40f8-b4fc-d6af6b3afa1b", "name": "network-vif-deleted", "tag": "6a55ee51-1001-4a61-a93a-c6e99dbaa47a"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:32:56.426385 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-3bbe645e-d1ae-4be0-a3a5-3671e63bdaa7 req-bad99204-e1a7-4075-a0ed-aceaadc93492 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:56.427325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-3bbe645e-d1ae-4be0-a3a5-3671e63bdaa7 req-bad99204-e1a7-4075-a0ed-aceaadc93492 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:56.427887 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-3bbe645e-d1ae-4be0-a3a5-3671e63bdaa7 req-bad99204-e1a7-4075-a0ed-aceaadc93492 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:56.442932 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-3bbe645e-d1ae-4be0-a3a5-3671e63bdaa7 req-bad99204-e1a7-4075-a0ed-aceaadc93492 service nova] Creating event network-vif-deleted:6a55ee51-1001-4a61-a93a-c6e99dbaa47a for instance f291a369-1330-40f8-b4fc-d6af6b3afa1b on hv-cinder-85220 Aug 18 14:32:56.449707 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-3bbe645e-d1ae-4be0-a3a5-3671e63bdaa7 req-bad99204-e1a7-4075-a0ed-aceaadc93492 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039635 Aug 18 14:32:56.450648 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 423/856] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:32:57.075064 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d90b5c98-7d4d-40f7-82e3-e0fce1ed884b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:57.075604 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d90b5c98-7d4d-40f7-82e3-e0fce1ed884b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:57.081939 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d90b5c98-7d4d-40f7-82e3-e0fce1ed884b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:57.082416 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d90b5c98-7d4d-40f7-82e3-e0fce1ed884b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:57.082857 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d90b5c98-7d4d-40f7-82e3-e0fce1ed884b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:57.083594 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d90b5c98-7d4d-40f7-82e3-e0fce1ed884b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:57.084048 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d90b5c98-7d4d-40f7-82e3-e0fce1ed884b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:57.084474 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d90b5c98-7d4d-40f7-82e3-e0fce1ed884b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:57.098592 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-d90b5c98-7d4d-40f7-82e3-e0fce1ed884b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] HTTP exception thrown: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d90b5c98-7d4d-40f7-82e3-e0fce1ed884b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Request method failure captured: Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 HTTP/1.1 Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kwUAIi1Wx1P_DjMBSJZmX7v2mJQ7rKoW_jNqpNVpZHhpqVoWG8AVUC7p67lFAx7hP76UlJyW0_uRF6gZJNpYnGAONNb3bYpdfnBFD6nOBS_HUxllybxwU0keCu9xu8kvzRLcZTI-iOamdcTZly1cFLuI57jJlGqNweUjUQxMfSHWgk Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: e25458a67a8b4394b0ebca1482524608 Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:32:57.100167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:32:57.101599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e25458a67a8b4394b0ebca1482524608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:57.101599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:57.101599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: e25458a67a8b4394b0ebca1482524608 Aug 18 14:32:57.101599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:57.101599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeShelveTestJSON-1050663749-project Aug 18 14:32:57.101599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:32:57.101599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:32:57.101599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 8a3d1fa830b540adbe68ef7cf7f08004 Aug 18 14:32:57.101599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1050663749-project Aug 18 14:32:57.101599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:32:57.101599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:32:57.101599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '95d09be0-5622-4167-859a-c81e38fc7218'} Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:57.103127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:32:57.104473 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.106276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d90b5c98-7d4d-40f7-82e3-e0fce1ed884b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Returning 404 to user: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:57.106276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d90b5c98-7d4d-40f7-82e3-e0fce1ed884b tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "DELETE /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 404 len: 111 microversion: 2.20 time: 0.030876 Aug 18 14:32:57.106276 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 434/857] 10.222.0.39 () {60 vars in 1280 bytes} [Thu Aug 18 14:32:57 2022] DELETE /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 14:32:57.110842 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-885c4220-60ba-40f5-9c69-8a29b4b98b24 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:57.111581 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-885c4220-60ba-40f5-9c69-8a29b4b98b24 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] [instance: 95d09be0-5622-4167-859a-c81e38fc7218] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:57.117822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-885c4220-60ba-40f5-9c69-8a29b4b98b24 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:57.118508 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-885c4220-60ba-40f5-9c69-8a29b4b98b24 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:57.118945 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-885c4220-60ba-40f5-9c69-8a29b4b98b24 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:57.119668 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-885c4220-60ba-40f5-9c69-8a29b4b98b24 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:57.120121 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-885c4220-60ba-40f5-9c69-8a29b4b98b24 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:57.120570 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-885c4220-60ba-40f5-9c69-8a29b4b98b24 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:57.134156 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-885c4220-60ba-40f5-9c69-8a29b4b98b24 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] HTTP exception thrown: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-885c4220-60ba-40f5-9c69-8a29b4b98b24 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Request method failure captured: Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 HTTP/1.1 Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_kwUAIi1Wx1P_DjMBSJZmX7v2mJQ7rKoW_jNqpNVpZHhpqVoWG8AVUC7p67lFAx7hP76UlJyW0_uRF6gZJNpYnGAONNb3bYpdfnBFD6nOBS_HUxllybxwU0keCu9xu8kvzRLcZTI-iOamdcTZly1cFLuI57jJlGqNweUjUQxMfSHWgk Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: e25458a67a8b4394b0ebca1482524608 Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:32:57.135929 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:32:57.137392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e25458a67a8b4394b0ebca1482524608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e25458a67a8b4394b0ebca1482524608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:57.137392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:57.137392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: e25458a67a8b4394b0ebca1482524608 Aug 18 14:32:57.137392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1050663749 Aug 18 14:32:57.137392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeShelveTestJSON-1050663749-project Aug 18 14:32:57.137392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:32:57.137392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:32:57.137392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 8a3d1fa830b540adbe68ef7cf7f08004 Aug 18 14:32:57.137392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1050663749-project Aug 18 14:32:57.137392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:32:57.137392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:32:57.137392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '95d09be0-5622-4167-859a-c81e38fc7218'} Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:57.138689 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. Aug 18 14:32:57.139954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.141320 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-885c4220-60ba-40f5-9c69-8a29b4b98b24 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] Returning 404 to user: Instance 95d09be0-5622-4167-859a-c81e38fc7218 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:57.141320 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-885c4220-60ba-40f5-9c69-8a29b4b98b24 tempest-AttachVolumeShelveTestJSON-1050663749 tempest-AttachVolumeShelveTestJSON-1050663749-project] 10.222.0.39 "GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218" status: 404 len: 111 microversion: 2.20 time: 0.030604 Aug 18 14:32:57.141320 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 424/858] 10.222.0.39 () {60 vars in 1277 bytes} [Thu Aug 18 14:32:57 2022] GET /compute/v2.1/servers/95d09be0-5622-4167-859a-c81e38fc7218 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 18 14:32:57.432890 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f68a6afb-7654-4df8-8011-a781a35dbfa5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:57.434172 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f68a6afb-7654-4df8-8011-a781a35dbfa5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] [instance: f291a369-1330-40f8-b4fc-d6af6b3afa1b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:32:57.442337 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f68a6afb-7654-4df8-8011-a781a35dbfa5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:57.442830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f68a6afb-7654-4df8-8011-a781a35dbfa5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:57.444130 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f68a6afb-7654-4df8-8011-a781a35dbfa5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:57.444722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f68a6afb-7654-4df8-8011-a781a35dbfa5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:32:57.445234 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f68a6afb-7654-4df8-8011-a781a35dbfa5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:32:57.445643 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f68a6afb-7654-4df8-8011-a781a35dbfa5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:32:57.459909 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-f68a6afb-7654-4df8-8011-a781a35dbfa5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] HTTP exception thrown: Instance f291a369-1330-40f8-b4fc-d6af6b3afa1b could not be found. Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f68a6afb-7654-4df8-8011-a781a35dbfa5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Request method failure captured: Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b HTTP/1.1 Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_kzuZQKKGIjpSCmzLJOsU1Moz5GOvMTsDihVn0oAvOkjFdku8HD-pB-cCoCXl5PCfU-6bkgVgJREmJA3Hqx3MQurQQjWVMOWOyDKNKxS7gcGaaPO40Anct-aB0A2xDnSEY6XLdtdov2m2-0WJ-PqFKhtoQtMFyMNVbO4KOJAr2GG3MI Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 7d21898f611b41e68cf9eb1b2f3edf8e Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-TestMinimumBasicScenario-409201551 Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:32:57.461975 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:32:57.463599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d21898f611b41e68cf9eb1b2f3edf8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7d21898f611b41e68cf9eb1b2f3edf8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d21898f611b41e68cf9eb1b2f3edf8e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7d21898f611b41e68cf9eb1b2f3edf8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:32:57.463599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-TestMinimumBasicScenario-409201551 Aug 18 14:32:57.463599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 7d21898f611b41e68cf9eb1b2f3edf8e Aug 18 14:32:57.463599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-TestMinimumBasicScenario-409201551 Aug 18 14:32:57.463599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-TestMinimumBasicScenario-409201551-project Aug 18 14:32:57.463599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:32:57.463599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:32:57.463599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: b7454072c7944ae0b442885ac7660a90 Aug 18 14:32:57.463599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-TestMinimumBasicScenario-409201551-project Aug 18 14:32:57.463599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:32:57.463599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance f291a369-1330-40f8-b4fc-d6af6b3afa1b could not be found. Aug 18 14:32:57.463599 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': 'f291a369-1330-40f8-b4fc-d6af6b3afa1b'} Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f291a369-1330-40f8-b4fc-d6af6b3afa1b could not be found. Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:32:57.464650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f291a369-1330-40f8-b4fc-d6af6b3afa1b could not be found. Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f291a369-1330-40f8-b4fc-d6af6b3afa1b could not be found. Aug 18 14:32:57.467496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:32:57.469759 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f68a6afb-7654-4df8-8011-a781a35dbfa5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Returning 404 to user: Instance f291a369-1330-40f8-b4fc-d6af6b3afa1b could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:32:57.469759 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f68a6afb-7654-4df8-8011-a781a35dbfa5 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b" status: 404 len: 111 microversion: 2.1 time: 0.034994 Aug 18 14:32:57.469759 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 435/859] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:32:57 2022] GET /compute/v2.1/servers/f291a369-1330-40f8-b4fc-d6af6b3afa1b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:32:57.473095 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cb1f35ee-7634-49a0-8a10-5c2d7c719d92 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] Calling method '.version_select at 0x7fb621f04820>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:32:57.493923 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cb1f35ee-7634-49a0-8a10-5c2d7c719d92 tempest-TestMinimumBasicScenario-409201551 tempest-TestMinimumBasicScenario-409201551-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-219290788" status: 202 len: 0 microversion: 2.1 time: 0.024676 Aug 18 14:32:57.495106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 425/860] 10.222.0.39 () {58 vars in 1269 bytes} [Thu Aug 18 14:32:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-219290788 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:33:05.382172 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cdab729d-6b01-4f12-b5fe-61c7f483e098 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:05.382670 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cdab729d-6b01-4f12-b5fe-61c7f483e098 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:05.390900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cdab729d-6b01-4f12-b5fe-61c7f483e098 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:05.391408 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cdab729d-6b01-4f12-b5fe-61c7f483e098 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:05.391856 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cdab729d-6b01-4f12-b5fe-61c7f483e098 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:05.392562 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cdab729d-6b01-4f12-b5fe-61c7f483e098 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:05.393021 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cdab729d-6b01-4f12-b5fe-61c7f483e098 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:05.393453 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cdab729d-6b01-4f12-b5fe-61c7f483e098 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:05.527135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-cdab729d-6b01-4f12-b5fe-61c7f483e098 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lazy-loading 'services' on Instance uuid 14e298a2-722b-4340-a4cc-7b5cf8596c17 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:33:05.651418 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cdab729d-6b01-4f12-b5fe-61c7f483e098 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/os-volume_attachments/43a4b5a1-e44c-48d4-bfaa-320364083e19" status: 202 len: 0 microversion: 2.1 time: 0.272837 Aug 18 14:33:05.668878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 436/861] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Aug 18 14:33:05 2022] DELETE /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/os-volume_attachments/43a4b5a1-e44c-48d4-bfaa-320364083e19 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:33:06.815555 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-554c93ee-5d3f-47f7-b9c3-b6f16c1d5f05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:33:06.823273 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-554c93ee-5d3f-47f7-b9c3-b6f16c1d5f05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:06.824057 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-554c93ee-5d3f-47f7-b9c3-b6f16c1d5f05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:06.824663 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-554c93ee-5d3f-47f7-b9c3-b6f16c1d5f05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:07.090190 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-554c93ee-5d3f-47f7-b9c3-b6f16c1d5f05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Going to try to stop instance {{(pid=120539) force_stop /opt/stack/nova/nova/compute/api.py:2752}} Aug 18 14:33:07.175720 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-554c93ee-5d3f-47f7-b9c3-b6f16c1d5f05 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "POST /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/action" status: 202 len: 0 microversion: 2.1 time: 0.364651 Aug 18 14:33:07.176591 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 426/862] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:33:06 2022] POST /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:33:07.187071 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d740e154-3aef-47b9-b40f-33f05d482db6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:07.188516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d740e154-3aef-47b9-b40f-33f05d482db6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:07.198141 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d740e154-3aef-47b9-b40f-33f05d482db6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:07.200874 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d740e154-3aef-47b9-b40f-33f05d482db6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:07.201443 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d740e154-3aef-47b9-b40f-33f05d482db6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:07.203671 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d740e154-3aef-47b9-b40f-33f05d482db6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:07.205301 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d740e154-3aef-47b9-b40f-33f05d482db6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:07.205837 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d740e154-3aef-47b9-b40f-33f05d482db6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:07.481515 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d740e154-3aef-47b9-b40f-33f05d482db6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:07.494931 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d740e154-3aef-47b9-b40f-33f05d482db6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1676 microversion: 2.1 time: 0.313049 Aug 18 14:33:07.496405 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 437/863] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:07 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1676 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:33:08.525262 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8419ef1d-5fb5-40bf-830a-4e05f237ff29 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:08.526267 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8419ef1d-5fb5-40bf-830a-4e05f237ff29 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:08.533633 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8419ef1d-5fb5-40bf-830a-4e05f237ff29 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:08.534264 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8419ef1d-5fb5-40bf-830a-4e05f237ff29 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:08.534787 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8419ef1d-5fb5-40bf-830a-4e05f237ff29 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:08.535672 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8419ef1d-5fb5-40bf-830a-4e05f237ff29 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:08.536200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8419ef1d-5fb5-40bf-830a-4e05f237ff29 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:08.536696 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8419ef1d-5fb5-40bf-830a-4e05f237ff29 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:08.694391 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8419ef1d-5fb5-40bf-830a-4e05f237ff29 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:08.703915 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8419ef1d-5fb5-40bf-830a-4e05f237ff29 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1676 microversion: 2.1 time: 0.183897 Aug 18 14:33:08.704644 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 427/864] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:08 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:33:09.726028 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a2c55e10-e87f-4df6-808e-af41e357cd78 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:09.727191 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a2c55e10-e87f-4df6-808e-af41e357cd78 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:09.733944 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2c55e10-e87f-4df6-808e-af41e357cd78 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:09.734430 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2c55e10-e87f-4df6-808e-af41e357cd78 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:09.734868 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2c55e10-e87f-4df6-808e-af41e357cd78 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:09.735585 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2c55e10-e87f-4df6-808e-af41e357cd78 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:09.736040 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2c55e10-e87f-4df6-808e-af41e357cd78 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:09.736462 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2c55e10-e87f-4df6-808e-af41e357cd78 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:09.865273 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a2c55e10-e87f-4df6-808e-af41e357cd78 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:09.874105 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a2c55e10-e87f-4df6-808e-af41e357cd78 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1676 microversion: 2.1 time: 0.152050 Aug 18 14:33:09.874755 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 438/865] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:09 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:33:10.895301 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b06b87fa-2813-49d5-852d-416991a91a67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:10.895949 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b06b87fa-2813-49d5-852d-416991a91a67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:10.902938 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b06b87fa-2813-49d5-852d-416991a91a67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:10.903445 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b06b87fa-2813-49d5-852d-416991a91a67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:10.903884 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b06b87fa-2813-49d5-852d-416991a91a67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:10.904575 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b06b87fa-2813-49d5-852d-416991a91a67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:10.905029 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b06b87fa-2813-49d5-852d-416991a91a67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:10.905457 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b06b87fa-2813-49d5-852d-416991a91a67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:10.909447 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:33:11.040122 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b06b87fa-2813-49d5-852d-416991a91a67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:11.048185 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b06b87fa-2813-49d5-852d-416991a91a67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1676 microversion: 2.1 time: 0.156798 Aug 18 14:33:11.048754 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 428/866] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:10 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:33:12.069858 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-39ac2af4-c87e-4b48-aeb1-fa453a220f09 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:12.071320 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-39ac2af4-c87e-4b48-aeb1-fa453a220f09 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:12.077729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39ac2af4-c87e-4b48-aeb1-fa453a220f09 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:12.078205 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39ac2af4-c87e-4b48-aeb1-fa453a220f09 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:12.078643 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39ac2af4-c87e-4b48-aeb1-fa453a220f09 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:12.079388 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39ac2af4-c87e-4b48-aeb1-fa453a220f09 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:12.079867 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39ac2af4-c87e-4b48-aeb1-fa453a220f09 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:12.080289 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39ac2af4-c87e-4b48-aeb1-fa453a220f09 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:12.230638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-39ac2af4-c87e-4b48-aeb1-fa453a220f09 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:12.238430 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-39ac2af4-c87e-4b48-aeb1-fa453a220f09 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1676 microversion: 2.1 time: 0.172434 Aug 18 14:33:12.238992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 439/867] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:12 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:33:13.261319 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f58843c0-bc18-4714-a7b7-9bf125bab355 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:13.262013 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f58843c0-bc18-4714-a7b7-9bf125bab355 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:13.268781 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f58843c0-bc18-4714-a7b7-9bf125bab355 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:13.269271 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f58843c0-bc18-4714-a7b7-9bf125bab355 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:13.269708 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f58843c0-bc18-4714-a7b7-9bf125bab355 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:13.270437 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f58843c0-bc18-4714-a7b7-9bf125bab355 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:13.270887 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f58843c0-bc18-4714-a7b7-9bf125bab355 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:13.271335 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f58843c0-bc18-4714-a7b7-9bf125bab355 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:13.422946 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f58843c0-bc18-4714-a7b7-9bf125bab355 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:13.431878 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f58843c0-bc18-4714-a7b7-9bf125bab355 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1676 microversion: 2.1 time: 0.175255 Aug 18 14:33:13.432451 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 429/868] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:13 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:33:14.453245 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4d0796d2-335e-4469-a104-1b35e93caa8a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:14.453858 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4d0796d2-335e-4469-a104-1b35e93caa8a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:14.460107 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d0796d2-335e-4469-a104-1b35e93caa8a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:14.461322 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d0796d2-335e-4469-a104-1b35e93caa8a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:14.461729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d0796d2-335e-4469-a104-1b35e93caa8a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:14.462410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d0796d2-335e-4469-a104-1b35e93caa8a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:14.462859 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d0796d2-335e-4469-a104-1b35e93caa8a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:14.463280 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d0796d2-335e-4469-a104-1b35e93caa8a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:14.608179 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4d0796d2-335e-4469-a104-1b35e93caa8a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:14.615846 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4d0796d2-335e-4469-a104-1b35e93caa8a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1676 microversion: 2.1 time: 0.166403 Aug 18 14:33:14.616414 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 440/869] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:14 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:33:15.637384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-68a7b586-4567-4ad5-b31e-d48af1fe1f6a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:15.637920 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-68a7b586-4567-4ad5-b31e-d48af1fe1f6a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:15.644737 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68a7b586-4567-4ad5-b31e-d48af1fe1f6a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:15.645300 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68a7b586-4567-4ad5-b31e-d48af1fe1f6a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:15.645830 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68a7b586-4567-4ad5-b31e-d48af1fe1f6a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:15.646654 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68a7b586-4567-4ad5-b31e-d48af1fe1f6a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:15.647171 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68a7b586-4567-4ad5-b31e-d48af1fe1f6a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:15.647694 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68a7b586-4567-4ad5-b31e-d48af1fe1f6a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:15.785369 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-68a7b586-4567-4ad5-b31e-d48af1fe1f6a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:15.793316 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-68a7b586-4567-4ad5-b31e-d48af1fe1f6a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1676 microversion: 2.1 time: 0.160120 Aug 18 14:33:15.793966 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 430/870] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:15 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:33:16.815715 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-41c01d99-3ce4-4184-b543-2942e7294d7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:16.816369 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-41c01d99-3ce4-4184-b543-2942e7294d7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:16.823872 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41c01d99-3ce4-4184-b543-2942e7294d7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:16.824572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41c01d99-3ce4-4184-b543-2942e7294d7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:16.825008 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41c01d99-3ce4-4184-b543-2942e7294d7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:16.825700 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41c01d99-3ce4-4184-b543-2942e7294d7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:16.826230 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41c01d99-3ce4-4184-b543-2942e7294d7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:16.826561 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41c01d99-3ce4-4184-b543-2942e7294d7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:16.959899 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-41c01d99-3ce4-4184-b543-2942e7294d7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:16.968694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-41c01d99-3ce4-4184-b543-2942e7294d7b tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1676 microversion: 2.1 time: 0.156927 Aug 18 14:33:16.969401 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 441/871] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:16 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:33:17.990854 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eff2bb3e-852b-4f57-b61a-3e77dfa4d2e1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:17.991502 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eff2bb3e-852b-4f57-b61a-3e77dfa4d2e1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:17.998709 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff2bb3e-852b-4f57-b61a-3e77dfa4d2e1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:17.999216 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff2bb3e-852b-4f57-b61a-3e77dfa4d2e1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:17.999684 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff2bb3e-852b-4f57-b61a-3e77dfa4d2e1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:18.000393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff2bb3e-852b-4f57-b61a-3e77dfa4d2e1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:18.000847 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff2bb3e-852b-4f57-b61a-3e77dfa4d2e1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:18.001274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff2bb3e-852b-4f57-b61a-3e77dfa4d2e1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:18.144899 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eff2bb3e-852b-4f57-b61a-3e77dfa4d2e1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:18.154877 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eff2bb3e-852b-4f57-b61a-3e77dfa4d2e1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1653 microversion: 2.1 time: 0.167742 Aug 18 14:33:18.155948 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 431/872] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:17 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1653 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:33:18.180619 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f4190302-8c50-4f12-ac61-7c08b07f57a2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:33:18.187190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4190302-8c50-4f12-ac61-7c08b07f57a2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:18.187784 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4190302-8c50-4f12-ac61-7c08b07f57a2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:18.188228 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4190302-8c50-4f12-ac61-7c08b07f57a2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:18.210184 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f4190302-8c50-4f12-ac61-7c08b07f57a2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Going to try to start instance {{(pid=120538) start /opt/stack/nova/nova/compute/api.py:2775}} Aug 18 14:33:18.227924 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:33:18.253363 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f4190302-8c50-4f12-ac61-7c08b07f57a2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "POST /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/action" status: 202 len: 0 microversion: 2.1 time: 0.077122 Aug 18 14:33:18.253954 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 442/873] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:33:18 2022] POST /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:33:18.262535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7dcd512d-1e9e-4b5e-97ef-5e992d73bde1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:18.263278 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7dcd512d-1e9e-4b5e-97ef-5e992d73bde1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:18.268821 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:33:18.270705 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dcd512d-1e9e-4b5e-97ef-5e992d73bde1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:18.271251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dcd512d-1e9e-4b5e-97ef-5e992d73bde1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:18.271760 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dcd512d-1e9e-4b5e-97ef-5e992d73bde1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:18.272456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dcd512d-1e9e-4b5e-97ef-5e992d73bde1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:18.273527 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dcd512d-1e9e-4b5e-97ef-5e992d73bde1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:18.274190 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dcd512d-1e9e-4b5e-97ef-5e992d73bde1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:18.427794 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7dcd512d-1e9e-4b5e-97ef-5e992d73bde1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:18.436347 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7dcd512d-1e9e-4b5e-97ef-5e992d73bde1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1662 microversion: 2.1 time: 0.177600 Aug 18 14:33:18.437397 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 432/874] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:18 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1662 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:33:19.459835 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fee82fd0-d90b-4859-be40-596fcf782d14 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:19.460579 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fee82fd0-d90b-4859-be40-596fcf782d14 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:19.462498 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=39 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:33:19.468042 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fee82fd0-d90b-4859-be40-596fcf782d14 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:19.468519 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fee82fd0-d90b-4859-be40-596fcf782d14 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:19.468954 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fee82fd0-d90b-4859-be40-596fcf782d14 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:19.469635 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fee82fd0-d90b-4859-be40-596fcf782d14 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:19.470084 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fee82fd0-d90b-4859-be40-596fcf782d14 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:19.470504 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fee82fd0-d90b-4859-be40-596fcf782d14 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:19.603558 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fee82fd0-d90b-4859-be40-596fcf782d14 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:19.611099 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fee82fd0-d90b-4859-be40-596fcf782d14 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1666 microversion: 2.1 time: 0.156008 Aug 18 14:33:19.611858 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 443/875] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:19 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:33:31.078110 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 14:33:31.078720 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Thu Aug 18 14:33:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 14:33:31.455960 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 14:33:31.456560 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Thu Aug 18 14:33:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 14:33:54.898286 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9170a801-5ae7-43bc-99d4-29430e6935e2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:54.901473 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9170a801-5ae7-43bc-99d4-29430e6935e2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:54.903613 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:33:54.904456 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=28 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:33:54.913758 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9170a801-5ae7-43bc-99d4-29430e6935e2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:54.914264 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9170a801-5ae7-43bc-99d4-29430e6935e2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:54.914704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9170a801-5ae7-43bc-99d4-29430e6935e2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:54.915483 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9170a801-5ae7-43bc-99d4-29430e6935e2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:54.915937 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9170a801-5ae7-43bc-99d4-29430e6935e2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:54.916536 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9170a801-5ae7-43bc-99d4-29430e6935e2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:54.949977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9170a801-5ae7-43bc-99d4-29430e6935e2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055775 Aug 18 14:33:54.950914 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 433/876] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:33:54 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:33:55.058219 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f543ca07-b8c6-4d12-8a3d-03abccca524c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:55.058810 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f543ca07-b8c6-4d12-8a3d-03abccca524c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:55.062176 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:33:55.062821 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:33:55.067645 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f543ca07-b8c6-4d12-8a3d-03abccca524c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:55.068141 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f543ca07-b8c6-4d12-8a3d-03abccca524c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:55.068584 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f543ca07-b8c6-4d12-8a3d-03abccca524c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:55.069293 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f543ca07-b8c6-4d12-8a3d-03abccca524c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:55.069927 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f543ca07-b8c6-4d12-8a3d-03abccca524c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:55.070358 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f543ca07-b8c6-4d12-8a3d-03abccca524c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:55.099788 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f543ca07-b8c6-4d12-8a3d-03abccca524c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:33:55.259109 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f543ca07-b8c6-4d12-8a3d-03abccca524c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 204 len: 0 microversion: 2.1 time: 0.204917 Aug 18 14:33:55.260544 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 444/877] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:33:55 2022] DELETE /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:33:55.269943 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4a7d52bb-b6d4-4216-98b3-f16dd808ced3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:55.270664 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4a7d52bb-b6d4-4216-98b3-f16dd808ced3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:55.277010 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a7d52bb-b6d4-4216-98b3-f16dd808ced3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:55.277768 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a7d52bb-b6d4-4216-98b3-f16dd808ced3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:55.278401 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a7d52bb-b6d4-4216-98b3-f16dd808ced3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:55.279337 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a7d52bb-b6d4-4216-98b3-f16dd808ced3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:55.280633 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a7d52bb-b6d4-4216-98b3-f16dd808ced3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:55.281614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a7d52bb-b6d4-4216-98b3-f16dd808ced3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:55.546098 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4a7d52bb-b6d4-4216-98b3-f16dd808ced3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:55.554296 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4a7d52bb-b6d4-4216-98b3-f16dd808ced3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1672 microversion: 2.1 time: 0.288306 Aug 18 14:33:55.555455 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 434/878] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:55 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1672 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:33:56.579670 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e37c916d-c29d-4623-9486-20fa1e6fe53c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:56.580991 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e37c916d-c29d-4623-9486-20fa1e6fe53c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:56.590921 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e37c916d-c29d-4623-9486-20fa1e6fe53c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:56.591693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e37c916d-c29d-4623-9486-20fa1e6fe53c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:56.592300 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e37c916d-c29d-4623-9486-20fa1e6fe53c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:56.593227 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e37c916d-c29d-4623-9486-20fa1e6fe53c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:56.593841 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e37c916d-c29d-4623-9486-20fa1e6fe53c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:56.594425 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e37c916d-c29d-4623-9486-20fa1e6fe53c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:56.777538 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e37c916d-c29d-4623-9486-20fa1e6fe53c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:56.787098 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e37c916d-c29d-4623-9486-20fa1e6fe53c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1672 microversion: 2.1 time: 0.213363 Aug 18 14:33:56.793179 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 445/879] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:56 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1672 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:33:57.816345 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f9f70488-d230-4fb9-99b8-a6920d09b16a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:57.818116 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f9f70488-d230-4fb9-99b8-a6920d09b16a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:57.842028 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9f70488-d230-4fb9-99b8-a6920d09b16a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:57.842680 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9f70488-d230-4fb9-99b8-a6920d09b16a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:57.844807 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9f70488-d230-4fb9-99b8-a6920d09b16a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:57.846232 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9f70488-d230-4fb9-99b8-a6920d09b16a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:57.846875 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9f70488-d230-4fb9-99b8-a6920d09b16a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:57.847500 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9f70488-d230-4fb9-99b8-a6920d09b16a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:57.968669 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f9f70488-d230-4fb9-99b8-a6920d09b16a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:57.984191 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f9f70488-d230-4fb9-99b8-a6920d09b16a tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1604 microversion: 2.1 time: 0.173683 Aug 18 14:33:57.985104 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 435/880] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:57 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1604 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:33:58.348752 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-11d5e92c-207f-4f08-88ac-adf7b1df93e9 req-0375ee1f-4f71-4c78-bfec-91a3d98d011f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e298a2-722b-4340-a4cc-7b5cf8596c17", "name": "network-vif-deleted", "tag": "e791bcac-2cb5-453d-a4bc-49e1afe3ebc8"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:33:58.373976 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-11d5e92c-207f-4f08-88ac-adf7b1df93e9 req-0375ee1f-4f71-4c78-bfec-91a3d98d011f service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:58.374714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-11d5e92c-207f-4f08-88ac-adf7b1df93e9 req-0375ee1f-4f71-4c78-bfec-91a3d98d011f service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:58.375848 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-11d5e92c-207f-4f08-88ac-adf7b1df93e9 req-0375ee1f-4f71-4c78-bfec-91a3d98d011f service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:58.396138 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-11d5e92c-207f-4f08-88ac-adf7b1df93e9 req-0375ee1f-4f71-4c78-bfec-91a3d98d011f service nova] Creating event network-vif-deleted:e791bcac-2cb5-453d-a4bc-49e1afe3ebc8 for instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 on hv-cinder-85220 Aug 18 14:33:58.404464 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-11d5e92c-207f-4f08-88ac-adf7b1df93e9 req-0375ee1f-4f71-4c78-bfec-91a3d98d011f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063222 Aug 18 14:33:58.405688 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 446/881] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:33:58.778797 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c3e74413-05dc-4bc9-9a1b-ec5c49311705 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Action: 'create', calling method: .version_select at 0x7fb621e97e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1701044862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbTA/2msm1dQwfApRp9vm2JjsDg5QifcHFRzr7beFuFqa5fCMXPQichc6VQZ//8cr2ZrkxqlcBzyjRggvfXGM2tdpdm53hDQaE0EkSY29JwslUsiEIfIGmBysL+Yl+ZyA=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:33:58.799909 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-c3e74413-05dc-4bc9-9a1b-ec5c49311705 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Getting quotas for project e87465b1253547a49284b8be4673305d. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:33:58.803861 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-c3e74413-05dc-4bc9-9a1b-ec5c49311705 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Getting quotas for user 3191363bf5794cfd91926141994e9d6b and project e87465b1253547a49284b8be4673305d. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:33:58.830011 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c3e74413-05dc-4bc9-9a1b-ec5c49311705 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.446488 Aug 18 14:33:58.830813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 436/882] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Aug 18 14:33:58 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:33:59.006617 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:33:59.007549 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:33:59.022412 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:59.023210 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:59.023845 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:59.025193 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:59.026182 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:59.026976 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:59.069376 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:33:59.069932 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:33:59.070373 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:33:59.070825 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lazy-loading 'fault' on Instance uuid 14e298a2-722b-4340-a4cc-7b5cf8596c17 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:33:59.133290 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:33:59.144716 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9da0348f-9c2e-4e80-8c16-5923e3784e64 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 200 len: 1328 microversion: 2.1 time: 0.142256 Aug 18 14:33:59.146568 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 447/883] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:33:59 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 1328 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:00.168549 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-acbd1210-d207-4824-8dfc-d4281be952d9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:00.169136 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-acbd1210-d207-4824-8dfc-d4281be952d9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:00.176741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acbd1210-d207-4824-8dfc-d4281be952d9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:00.177244 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acbd1210-d207-4824-8dfc-d4281be952d9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:00.177764 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acbd1210-d207-4824-8dfc-d4281be952d9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:00.178575 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acbd1210-d207-4824-8dfc-d4281be952d9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:00.179094 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acbd1210-d207-4824-8dfc-d4281be952d9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:00.179614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acbd1210-d207-4824-8dfc-d4281be952d9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:00.195981 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-acbd1210-d207-4824-8dfc-d4281be952d9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] HTTP exception thrown: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-acbd1210-d207-4824-8dfc-d4281be952d9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Request method failure captured: Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 HTTP/1.1 Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_k0S-eQbRWCc5BXphExm5Ld5x_jGf8-cDqOv4se9AarEyEn1fZIwBVqJVR0HFHwUhy2SKdqrxKavj6imhbf7PZAXn59ukzUsKgJNcsf-t3Fjk5MV_An8oRF2PbTH4yWi-u72656ZiMsho9HcpnFkzfDiB5Idtx6jl5788onGbd4rsxc Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: ac3936135be542a4a1e0370bac465278 Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:34:00.198614 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:34:00.200384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac3936135be542a4a1e0370bac465278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac3936135be542a4a1e0370bac465278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac3936135be542a4a1e0370bac465278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac3936135be542a4a1e0370bac465278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:34:00.200384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:34:00.200384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: ac3936135be542a4a1e0370bac465278 Aug 18 14:34:00.200384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:34:00.200384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeTestJSON-805751942-project Aug 18 14:34:00.200384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:34:00.200384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:34:00.200384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 660aa77ae39a47e8b3b607d0839ed3dc Aug 18 14:34:00.200384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeTestJSON-805751942-project Aug 18 14:34:00.200384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:34:00.200384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:34:00.200384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '14e298a2-722b-4340-a4cc-7b5cf8596c17'} Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:34:00.201325 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:34:00.202956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:34:00.204533 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-acbd1210-d207-4824-8dfc-d4281be952d9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Returning 404 to user: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:34:00.204533 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-acbd1210-d207-4824-8dfc-d4281be952d9 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 404 len: 111 microversion: 2.1 time: 0.036233 Aug 18 14:34:00.204533 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 437/884] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:00 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:34:00.210205 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6abfed0c-630a-4dbc-a1e3-f797b29bddee tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '.version_select at 0x7fb622008ca0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:00.234173 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6abfed0c-630a-4dbc-a1e3-f797b29bddee tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922625841" status: 202 len: 0 microversion: 2.1 time: 0.027859 Aug 18 14:34:00.234747 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 448/885] 10.222.0.39 () {58 vars in 1221 bytes} [Thu Aug 18 14:34:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922625841 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:34:00.925778 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0f7a2093-b0e6-4aa2-b504-0734bc252e34 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Action: 'create', calling method: .version_select at 0x7fb621e97790>, body: {"keypair": {"name": "tempest-keypair-1167815893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlY99CwDJ+zrQbD3VLUjpg5xOaBk4EC/nFMA3OUMJOFRYspj5YZCfveRSCsXCpVjZb9Sv8AN/eybTygr1uDjdUSgESwoBF3GYXe+Cxs9xe+dFBuCn722uhumAkfgyd0iA=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:34:00.941488 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-0f7a2093-b0e6-4aa2-b504-0734bc252e34 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Getting quotas for project ac3936135be542a4a1e0370bac465278. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:34:00.945174 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-0f7a2093-b0e6-4aa2-b504-0734bc252e34 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Getting quotas for user 660aa77ae39a47e8b3b607d0839ed3dc and project ac3936135be542a4a1e0370bac465278. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:34:00.970383 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0f7a2093-b0e6-4aa2-b504-0734bc252e34 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048472 Aug 18 14:34:00.970982 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 438/886] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Aug 18 14:34:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:34:02.439722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1117772087", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77c79277-fde9-4b51-a36d-6832024b6513"}], "security_groups": [{"name": "tempest-securitygroup--314791990"}], "key_name": "tempest-keypair-1167815893", "user_data": "}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:34:02.551539 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] validate_networks() for [('77c79277-fde9-4b51-a36d-6832024b6513', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:34:02.945164 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:34:02.945596 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:34:02.946078 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:34:02.946525 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:34:02.946974 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:34:02.955955 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:02.956439 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:02.956876 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:02.957602 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:02.958057 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:02.958485 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:02.976153 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Getting quotas for project ac3936135be542a4a1e0370bac465278. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:34:02.980802 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Getting quotas for user 660aa77ae39a47e8b3b607d0839ed3dc and project ac3936135be542a4a1e0370bac465278. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:34:02.992296 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:34:02.998281 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:34:03.054030 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-534b0fff-1827-4d6c-a70d-0250db2bc358 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.618538 Aug 18 14:34:03.054673 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 449/887] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:34:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:34:03.066006 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d0d80ba2-f813-4a1b-8299-d4d9b7c19991 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:03.066625 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d0d80ba2-f813-4a1b-8299-d4d9b7c19991 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:03.124466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d0d80ba2-f813-4a1b-8299-d4d9b7c19991 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:03.131328 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d0d80ba2-f813-4a1b-8299-d4d9b7c19991 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 200 len: 1238 microversion: 2.1 time: 0.069638 Aug 18 14:34:03.131923 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 439/888] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:03 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:04.153979 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a5fdeebf-8d0b-4571-ab8b-6ec07899afa2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:04.155264 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a5fdeebf-8d0b-4571-ab8b-6ec07899afa2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:04.161545 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5fdeebf-8d0b-4571-ab8b-6ec07899afa2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:04.162041 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5fdeebf-8d0b-4571-ab8b-6ec07899afa2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:04.162510 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5fdeebf-8d0b-4571-ab8b-6ec07899afa2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:04.163217 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5fdeebf-8d0b-4571-ab8b-6ec07899afa2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:04.163712 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5fdeebf-8d0b-4571-ab8b-6ec07899afa2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:04.164150 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5fdeebf-8d0b-4571-ab8b-6ec07899afa2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:04.241153 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a5fdeebf-8d0b-4571-ab8b-6ec07899afa2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:04.250880 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a5fdeebf-8d0b-4571-ab8b-6ec07899afa2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 200 len: 1296 microversion: 2.1 time: 0.101250 Aug 18 14:34:04.251497 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 450/889] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:04 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 1296 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:05.272473 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cd6ac69b-9bd2-42c7-a78d-f100ab22c5fa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:05.274171 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cd6ac69b-9bd2-42c7-a78d-f100ab22c5fa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:05.282081 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd6ac69b-9bd2-42c7-a78d-f100ab22c5fa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:05.283446 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd6ac69b-9bd2-42c7-a78d-f100ab22c5fa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:05.284301 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd6ac69b-9bd2-42c7-a78d-f100ab22c5fa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:05.285194 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd6ac69b-9bd2-42c7-a78d-f100ab22c5fa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:05.285663 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd6ac69b-9bd2-42c7-a78d-f100ab22c5fa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:05.286744 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd6ac69b-9bd2-42c7-a78d-f100ab22c5fa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:05.448204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cd6ac69b-9bd2-42c7-a78d-f100ab22c5fa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:05.456281 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cd6ac69b-9bd2-42c7-a78d-f100ab22c5fa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 200 len: 1363 microversion: 2.1 time: 0.188055 Aug 18 14:34:05.456863 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 440/890] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:05 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:05.513638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-2872b9ae-a4aa-4260-988f-dd83e096db93 req-4e35ef59-ed0d-4dae-80eb-3d29964f7dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5ad3c7-d8b1-4391-ad68-7191711e578b", "tag": "f126f3db-a078-45d3-a8ad-f75ce982a16a"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:34:05.534924 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2872b9ae-a4aa-4260-988f-dd83e096db93 req-4e35ef59-ed0d-4dae-80eb-3d29964f7dce service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:05.535920 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2872b9ae-a4aa-4260-988f-dd83e096db93 req-4e35ef59-ed0d-4dae-80eb-3d29964f7dce service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:05.536582 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2872b9ae-a4aa-4260-988f-dd83e096db93 req-4e35ef59-ed0d-4dae-80eb-3d29964f7dce service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:05.550296 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-2872b9ae-a4aa-4260-988f-dd83e096db93 req-4e35ef59-ed0d-4dae-80eb-3d29964f7dce service nova] Creating event network-changed:f126f3db-a078-45d3-a8ad-f75ce982a16a for instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b on hv-cinder-85220 Aug 18 14:34:05.556916 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-2872b9ae-a4aa-4260-988f-dd83e096db93 req-4e35ef59-ed0d-4dae-80eb-3d29964f7dce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055030 Aug 18 14:34:05.557807 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 451/891] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:34:06.477330 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bf2702a7-e30a-46cb-b9e4-63ad88299785 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:06.478306 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf2702a7-e30a-46cb-b9e4-63ad88299785 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:06.485639 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf2702a7-e30a-46cb-b9e4-63ad88299785 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:06.486149 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf2702a7-e30a-46cb-b9e4-63ad88299785 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:06.486782 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf2702a7-e30a-46cb-b9e4-63ad88299785 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:06.487589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf2702a7-e30a-46cb-b9e4-63ad88299785 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:06.488054 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf2702a7-e30a-46cb-b9e4-63ad88299785 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:06.488488 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf2702a7-e30a-46cb-b9e4-63ad88299785 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:06.624000 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bf2702a7-e30a-46cb-b9e4-63ad88299785 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:06.631698 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bf2702a7-e30a-46cb-b9e4-63ad88299785 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 200 len: 1363 microversion: 2.1 time: 0.158276 Aug 18 14:34:06.632225 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 441/892] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:06 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:07.655132 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4fd24498-c904-4d02-a740-02537965725e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:07.655762 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4fd24498-c904-4d02-a740-02537965725e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:07.661921 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fd24498-c904-4d02-a740-02537965725e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:07.662393 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fd24498-c904-4d02-a740-02537965725e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:07.662836 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fd24498-c904-4d02-a740-02537965725e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:07.663575 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fd24498-c904-4d02-a740-02537965725e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:07.664031 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fd24498-c904-4d02-a740-02537965725e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:07.664723 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fd24498-c904-4d02-a740-02537965725e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:07.802986 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4fd24498-c904-4d02-a740-02537965725e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:07.811226 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4fd24498-c904-4d02-a740-02537965725e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 200 len: 1363 microversion: 2.1 time: 0.161009 Aug 18 14:34:07.811845 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 452/893] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:07 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:08.832506 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-75174809-12a3-4149-9364-de4b9bd1b0de tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:08.833128 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-75174809-12a3-4149-9364-de4b9bd1b0de tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:08.840816 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-75174809-12a3-4149-9364-de4b9bd1b0de tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:08.841466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-75174809-12a3-4149-9364-de4b9bd1b0de tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:08.842007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-75174809-12a3-4149-9364-de4b9bd1b0de tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:08.842770 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-75174809-12a3-4149-9364-de4b9bd1b0de tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:08.843235 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-75174809-12a3-4149-9364-de4b9bd1b0de tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:08.843704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-75174809-12a3-4149-9364-de4b9bd1b0de tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:08.990486 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-75174809-12a3-4149-9364-de4b9bd1b0de tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:08.999116 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-75174809-12a3-4149-9364-de4b9bd1b0de tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 200 len: 1363 microversion: 2.1 time: 0.170464 Aug 18 14:34:08.999715 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 442/894] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:08 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:10.023623 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-65a860d1-3e5c-4f9d-a3fb-54a96b81afc7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:10.025764 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-65a860d1-3e5c-4f9d-a3fb-54a96b81afc7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:10.032622 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65a860d1-3e5c-4f9d-a3fb-54a96b81afc7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:10.033114 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65a860d1-3e5c-4f9d-a3fb-54a96b81afc7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:10.033561 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65a860d1-3e5c-4f9d-a3fb-54a96b81afc7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:10.034263 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65a860d1-3e5c-4f9d-a3fb-54a96b81afc7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:10.034718 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65a860d1-3e5c-4f9d-a3fb-54a96b81afc7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:10.035145 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65a860d1-3e5c-4f9d-a3fb-54a96b81afc7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:10.163428 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-65a860d1-3e5c-4f9d-a3fb-54a96b81afc7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:10.171147 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-65a860d1-3e5c-4f9d-a3fb-54a96b81afc7 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 200 len: 1363 microversion: 2.1 time: 0.151666 Aug 18 14:34:10.171736 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 453/895] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:10 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:10.929340 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-77fbb804-81d3-4f2f-b86c-296633d98ea2 req-f748fb51-2248-4657-8855-a1aac1780dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5ad3c7-d8b1-4391-ad68-7191711e578b", "name": "network-vif-plugged", "status": "completed", "tag": "f126f3db-a078-45d3-a8ad-f75ce982a16a"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:34:10.941276 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-77fbb804-81d3-4f2f-b86c-296633d98ea2 req-f748fb51-2248-4657-8855-a1aac1780dc7 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:10.941761 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-77fbb804-81d3-4f2f-b86c-296633d98ea2 req-f748fb51-2248-4657-8855-a1aac1780dc7 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:10.942191 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-77fbb804-81d3-4f2f-b86c-296633d98ea2 req-f748fb51-2248-4657-8855-a1aac1780dc7 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:10.954079 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-77fbb804-81d3-4f2f-b86c-296633d98ea2 req-f748fb51-2248-4657-8855-a1aac1780dc7 service nova] Creating event network-vif-plugged:f126f3db-a078-45d3-a8ad-f75ce982a16a for instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b on hv-cinder-85220 Aug 18 14:34:10.959464 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-77fbb804-81d3-4f2f-b86c-296633d98ea2 req-f748fb51-2248-4657-8855-a1aac1780dc7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033718 Aug 18 14:34:10.960053 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 443/896] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:34:11.191793 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c90ac55b-b3c2-447f-aea6-44c9b92931d2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:11.192416 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c90ac55b-b3c2-447f-aea6-44c9b92931d2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:11.199111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c90ac55b-b3c2-447f-aea6-44c9b92931d2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:11.199652 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c90ac55b-b3c2-447f-aea6-44c9b92931d2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:11.200096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c90ac55b-b3c2-447f-aea6-44c9b92931d2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:11.200787 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c90ac55b-b3c2-447f-aea6-44c9b92931d2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:11.201241 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c90ac55b-b3c2-447f-aea6-44c9b92931d2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:11.201694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c90ac55b-b3c2-447f-aea6-44c9b92931d2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:11.328940 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c90ac55b-b3c2-447f-aea6-44c9b92931d2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:11.336602 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c90ac55b-b3c2-447f-aea6-44c9b92931d2 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 200 len: 1363 microversion: 2.1 time: 0.148610 Aug 18 14:34:11.337719 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 454/897] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:11 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:12.359301 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-063d0a09-f815-4c80-805a-55f50d55a614 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:12.360039 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-063d0a09-f815-4c80-805a-55f50d55a614 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:12.366611 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-063d0a09-f815-4c80-805a-55f50d55a614 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:12.367089 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-063d0a09-f815-4c80-805a-55f50d55a614 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:12.367550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-063d0a09-f815-4c80-805a-55f50d55a614 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:12.368238 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-063d0a09-f815-4c80-805a-55f50d55a614 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:12.368690 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-063d0a09-f815-4c80-805a-55f50d55a614 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:12.369115 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-063d0a09-f815-4c80-805a-55f50d55a614 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:12.507131 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-063d0a09-f815-4c80-805a-55f50d55a614 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:12.515163 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-063d0a09-f815-4c80-805a-55f50d55a614 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 200 len: 1549 microversion: 2.1 time: 0.160251 Aug 18 14:34:12.515774 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 444/898] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:12 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:12.535221 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-467a264d-fc1c-459d-a2fc-080cf3f60f69 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:12.535758 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-467a264d-fc1c-459d-a2fc-080cf3f60f69 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:12.542969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-467a264d-fc1c-459d-a2fc-080cf3f60f69 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:12.543607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-467a264d-fc1c-459d-a2fc-080cf3f60f69 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:12.544047 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-467a264d-fc1c-459d-a2fc-080cf3f60f69 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:12.544732 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-467a264d-fc1c-459d-a2fc-080cf3f60f69 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:12.545213 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-467a264d-fc1c-459d-a2fc-080cf3f60f69 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:12.545636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-467a264d-fc1c-459d-a2fc-080cf3f60f69 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:12.627867 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-467a264d-fc1c-459d-a2fc-080cf3f60f69 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096400 Aug 18 14:34:12.628466 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 455/899] 10.222.0.39 () {58 vars in 1275 bytes} [Thu Aug 18 14:34:12 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:34:13.555143 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-ccf9b55f-a939-4526-b2bf-567706cdae86 req-c94cdd73-fa1d-4b10-85e3-7f50cc7e1ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c5ad3c7-d8b1-4391-ad68-7191711e578b", "tag": "f126f3db-a078-45d3-a8ad-f75ce982a16a"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:34:13.560694 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=10 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:13.567574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ccf9b55f-a939-4526-b2bf-567706cdae86 req-c94cdd73-fa1d-4b10-85e3-7f50cc7e1ae3 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:13.568070 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ccf9b55f-a939-4526-b2bf-567706cdae86 req-c94cdd73-fa1d-4b10-85e3-7f50cc7e1ae3 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:13.568510 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ccf9b55f-a939-4526-b2bf-567706cdae86 req-c94cdd73-fa1d-4b10-85e3-7f50cc7e1ae3 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:13.580393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-ccf9b55f-a939-4526-b2bf-567706cdae86 req-c94cdd73-fa1d-4b10-85e3-7f50cc7e1ae3 service nova] Creating event network-changed:f126f3db-a078-45d3-a8ad-f75ce982a16a for instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b on hv-cinder-85220 Aug 18 14:34:13.585991 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-ccf9b55f-a939-4526-b2bf-567706cdae86 req-c94cdd73-fa1d-4b10-85e3-7f50cc7e1ae3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034547 Aug 18 14:34:13.586591 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 445/900] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:34:15.467021 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:15.467818 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:15.472166 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-582843992", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1701044862", "security_groups": [{"name": "tempest-secgroup-smoke-1339569545"}], "block_device_mapping_v2": [{"uuid": "7ba2d025-e061-44de-8e8e-e000cb440fea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "95ff3be2-bdc5-4aad-b19b-f4b034623f47"}]}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:34:15.618454 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] validate_networks() for [('95ff3be2-bdc5-4aad-b19b-f4b034623f47', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:34:16.234959 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:34:16.235422 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:34:16.235911 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:34:16.236330 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:34:16.236810 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:34:16.245955 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:16.246374 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:16.246813 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:16.247607 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:16.248068 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:16.248499 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:16.265806 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Getting quotas for project e87465b1253547a49284b8be4673305d. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:34:16.269813 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Getting quotas for user 3191363bf5794cfd91926141994e9d6b and project e87465b1253547a49284b8be4673305d. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:34:16.330102 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:34:16.332344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ba2d025-e061-44de-8e8e-e000cb440fea',volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:34:16.474435 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-216e410a-50b1-42cf-9f9f-fd28f697ec1c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.008088 Aug 18 14:34:16.475434 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 456/901] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:34:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:34:16.486859 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9811b3de-6252-478d-bf5e-b7b8ef9dba1a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:16.487796 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9811b3de-6252-478d-bf5e-b7b8ef9dba1a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:16.559756 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9811b3de-6252-478d-bf5e-b7b8ef9dba1a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:16.567535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9811b3de-6252-478d-bf5e-b7b8ef9dba1a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1094 microversion: 2.1 time: 0.084853 Aug 18 14:34:16.568007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 446/902] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:16 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:17.589091 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-39662918-2a19-4eaf-89bd-b3510998e9d8 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:17.589758 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-39662918-2a19-4eaf-89bd-b3510998e9d8 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:17.596995 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39662918-2a19-4eaf-89bd-b3510998e9d8 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:17.597563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39662918-2a19-4eaf-89bd-b3510998e9d8 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:17.598128 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39662918-2a19-4eaf-89bd-b3510998e9d8 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:17.598888 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39662918-2a19-4eaf-89bd-b3510998e9d8 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:17.599438 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39662918-2a19-4eaf-89bd-b3510998e9d8 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:17.599932 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39662918-2a19-4eaf-89bd-b3510998e9d8 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:17.671179 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-39662918-2a19-4eaf-89bd-b3510998e9d8 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:17.678889 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-39662918-2a19-4eaf-89bd-b3510998e9d8 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1210 microversion: 2.1 time: 0.094708 Aug 18 14:34:17.679471 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 457/903] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:17 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:18.700964 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a4e17565-ef4d-49db-8ca4-b566f8f3bbd0 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:18.701704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a4e17565-ef4d-49db-8ca4-b566f8f3bbd0 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:18.709346 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4e17565-ef4d-49db-8ca4-b566f8f3bbd0 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:18.709948 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4e17565-ef4d-49db-8ca4-b566f8f3bbd0 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:18.710396 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4e17565-ef4d-49db-8ca4-b566f8f3bbd0 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:18.711246 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4e17565-ef4d-49db-8ca4-b566f8f3bbd0 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:18.711757 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4e17565-ef4d-49db-8ca4-b566f8f3bbd0 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:18.712189 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4e17565-ef4d-49db-8ca4-b566f8f3bbd0 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:18.745008 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-89492be4-e5f3-40b2-9d28-389a4ff7ee01 req-08ef5e96-9455-41d4-b28c-e232197da99d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f49170-7caf-4e52-8328-d67867701796", "tag": "debb6e48-b9f6-494e-ae2b-d352ff3d6c73"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:34:18.772964 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-89492be4-e5f3-40b2-9d28-389a4ff7ee01 req-08ef5e96-9455-41d4-b28c-e232197da99d service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:18.773621 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-89492be4-e5f3-40b2-9d28-389a4ff7ee01 req-08ef5e96-9455-41d4-b28c-e232197da99d service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:18.774613 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-89492be4-e5f3-40b2-9d28-389a4ff7ee01 req-08ef5e96-9455-41d4-b28c-e232197da99d service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:18.788074 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-89492be4-e5f3-40b2-9d28-389a4ff7ee01 req-08ef5e96-9455-41d4-b28c-e232197da99d service nova] Creating event network-changed:debb6e48-b9f6-494e-ae2b-d352ff3d6c73 for instance 16f49170-7caf-4e52-8328-d67867701796 on hv-cinder-85220 Aug 18 14:34:18.794686 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-89492be4-e5f3-40b2-9d28-389a4ff7ee01 req-08ef5e96-9455-41d4-b28c-e232197da99d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053833 Aug 18 14:34:18.796344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 458/904] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:34:18.864137 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a4e17565-ef4d-49db-8ca4-b566f8f3bbd0 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:18.872035 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a4e17565-ef4d-49db-8ca4-b566f8f3bbd0 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1266 microversion: 2.1 time: 0.175785 Aug 18 14:34:18.872597 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 447/905] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:18 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:19.894718 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c3e7392d-9105-4617-a904-4684ffc81bb1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:19.895461 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c3e7392d-9105-4617-a904-4684ffc81bb1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:19.902353 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3e7392d-9105-4617-a904-4684ffc81bb1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:19.902840 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3e7392d-9105-4617-a904-4684ffc81bb1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:19.903283 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3e7392d-9105-4617-a904-4684ffc81bb1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:19.904008 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3e7392d-9105-4617-a904-4684ffc81bb1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:19.904471 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3e7392d-9105-4617-a904-4684ffc81bb1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:19.904903 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3e7392d-9105-4617-a904-4684ffc81bb1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:20.050706 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c3e7392d-9105-4617-a904-4684ffc81bb1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:20.059465 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c3e7392d-9105-4617-a904-4684ffc81bb1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1266 microversion: 2.1 time: 0.169430 Aug 18 14:34:20.060035 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 459/906] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:19 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:21.080166 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ebc8dce3-7073-427e-aada-44d57b51a2a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:21.080811 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ebc8dce3-7073-427e-aada-44d57b51a2a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:21.087191 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebc8dce3-7073-427e-aada-44d57b51a2a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:21.088040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebc8dce3-7073-427e-aada-44d57b51a2a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:21.088487 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebc8dce3-7073-427e-aada-44d57b51a2a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:21.089327 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebc8dce3-7073-427e-aada-44d57b51a2a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:21.089778 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebc8dce3-7073-427e-aada-44d57b51a2a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:21.090201 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebc8dce3-7073-427e-aada-44d57b51a2a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:21.224154 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ebc8dce3-7073-427e-aada-44d57b51a2a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:21.232452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ebc8dce3-7073-427e-aada-44d57b51a2a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1266 microversion: 2.1 time: 0.156190 Aug 18 14:34:21.233007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 448/907] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:21 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:22.254175 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bff3ca50-327a-439e-a362-06a687bd39fb tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:22.254816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bff3ca50-327a-439e-a362-06a687bd39fb tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:22.262266 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bff3ca50-327a-439e-a362-06a687bd39fb tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:22.262753 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bff3ca50-327a-439e-a362-06a687bd39fb tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:22.263192 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bff3ca50-327a-439e-a362-06a687bd39fb tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:22.263928 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bff3ca50-327a-439e-a362-06a687bd39fb tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:22.264387 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bff3ca50-327a-439e-a362-06a687bd39fb tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:22.264841 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bff3ca50-327a-439e-a362-06a687bd39fb tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:22.396416 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bff3ca50-327a-439e-a362-06a687bd39fb tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:22.404214 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bff3ca50-327a-439e-a362-06a687bd39fb tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1266 microversion: 2.1 time: 0.153958 Aug 18 14:34:22.404783 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 460/908] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:22 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:23.425314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9896b2ef-8359-4926-9e89-fcfe2dc2b971 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:23.425924 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9896b2ef-8359-4926-9e89-fcfe2dc2b971 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:23.433007 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9896b2ef-8359-4926-9e89-fcfe2dc2b971 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:23.433413 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9896b2ef-8359-4926-9e89-fcfe2dc2b971 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:23.433849 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9896b2ef-8359-4926-9e89-fcfe2dc2b971 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:23.434535 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9896b2ef-8359-4926-9e89-fcfe2dc2b971 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:23.434993 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9896b2ef-8359-4926-9e89-fcfe2dc2b971 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:23.435447 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9896b2ef-8359-4926-9e89-fcfe2dc2b971 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:23.564769 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9896b2ef-8359-4926-9e89-fcfe2dc2b971 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:23.572951 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9896b2ef-8359-4926-9e89-fcfe2dc2b971 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1266 microversion: 2.1 time: 0.150939 Aug 18 14:34:23.573897 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 449/909] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:23 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:24.594821 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6fd90f25-d970-4de5-8bad-fa75f13cf859 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:24.595459 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6fd90f25-d970-4de5-8bad-fa75f13cf859 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:24.601769 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6fd90f25-d970-4de5-8bad-fa75f13cf859 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:24.602246 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6fd90f25-d970-4de5-8bad-fa75f13cf859 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:24.602679 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6fd90f25-d970-4de5-8bad-fa75f13cf859 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:24.603361 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6fd90f25-d970-4de5-8bad-fa75f13cf859 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:24.604448 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6fd90f25-d970-4de5-8bad-fa75f13cf859 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:24.604863 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6fd90f25-d970-4de5-8bad-fa75f13cf859 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:24.735878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6fd90f25-d970-4de5-8bad-fa75f13cf859 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:24.743465 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6fd90f25-d970-4de5-8bad-fa75f13cf859 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1266 microversion: 2.1 time: 0.152438 Aug 18 14:34:24.744023 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 461/910] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:24 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:34:25.764803 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ba4ee681-fdb1-4630-b8c3-b28cb5c0f0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:25.765356 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ba4ee681-fdb1-4630-b8c3-b28cb5c0f0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:25.767804 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:25.773017 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba4ee681-fdb1-4630-b8c3-b28cb5c0f0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:25.773504 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba4ee681-fdb1-4630-b8c3-b28cb5c0f0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:25.773944 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba4ee681-fdb1-4630-b8c3-b28cb5c0f0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:25.774640 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba4ee681-fdb1-4630-b8c3-b28cb5c0f0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:25.775092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba4ee681-fdb1-4630-b8c3-b28cb5c0f0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:25.776149 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba4ee681-fdb1-4630-b8c3-b28cb5c0f0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:25.779507 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=67 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:25.910427 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ba4ee681-fdb1-4630-b8c3-b28cb5c0f0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:25.918428 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ba4ee681-fdb1-4630-b8c3-b28cb5c0f0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1266 microversion: 2.1 time: 0.157560 Aug 18 14:34:25.919004 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 450/911] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:25 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:26.939503 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-611e5a3b-5362-4130-b8f8-4ee678a6d805 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:26.940149 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-611e5a3b-5362-4130-b8f8-4ee678a6d805 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:26.942572 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:26.943341 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:26.944151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:26.950768 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-611e5a3b-5362-4130-b8f8-4ee678a6d805 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:26.951256 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-611e5a3b-5362-4130-b8f8-4ee678a6d805 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:26.951717 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-611e5a3b-5362-4130-b8f8-4ee678a6d805 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:26.952416 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-611e5a3b-5362-4130-b8f8-4ee678a6d805 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:26.952896 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-611e5a3b-5362-4130-b8f8-4ee678a6d805 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:26.953322 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-611e5a3b-5362-4130-b8f8-4ee678a6d805 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:26.958013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:27.092142 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-611e5a3b-5362-4130-b8f8-4ee678a6d805 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:27.099874 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-611e5a3b-5362-4130-b8f8-4ee678a6d805 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1266 microversion: 2.1 time: 0.164243 Aug 18 14:34:27.100436 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 462/912] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:26 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:28.121415 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e7f93cf7-e476-4d4b-9c1f-3a34896b3c87 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:28.121944 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e7f93cf7-e476-4d4b-9c1f-3a34896b3c87 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:28.123909 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:28.130049 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7f93cf7-e476-4d4b-9c1f-3a34896b3c87 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:28.130536 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7f93cf7-e476-4d4b-9c1f-3a34896b3c87 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:28.131082 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7f93cf7-e476-4d4b-9c1f-3a34896b3c87 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:28.131852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7f93cf7-e476-4d4b-9c1f-3a34896b3c87 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:28.132303 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7f93cf7-e476-4d4b-9c1f-3a34896b3c87 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:28.132722 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7f93cf7-e476-4d4b-9c1f-3a34896b3c87 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:28.264261 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e7f93cf7-e476-4d4b-9c1f-3a34896b3c87 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:28.271919 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e7f93cf7-e476-4d4b-9c1f-3a34896b3c87 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1266 microversion: 2.1 time: 0.154772 Aug 18 14:34:28.272479 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 451/913] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:28 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:29.001939 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-6a3affef-f241-407b-9e6e-7b248375c6e8 req-5b6a0984-72c9-45c7-882d-efa31dda95ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f49170-7caf-4e52-8328-d67867701796", "name": "network-vif-plugged", "status": "completed", "tag": "debb6e48-b9f6-494e-ae2b-d352ff3d6c73"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:34:29.012102 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6a3affef-f241-407b-9e6e-7b248375c6e8 req-5b6a0984-72c9-45c7-882d-efa31dda95ff service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:29.012587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6a3affef-f241-407b-9e6e-7b248375c6e8 req-5b6a0984-72c9-45c7-882d-efa31dda95ff service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:29.013142 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6a3affef-f241-407b-9e6e-7b248375c6e8 req-5b6a0984-72c9-45c7-882d-efa31dda95ff service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:29.024379 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-6a3affef-f241-407b-9e6e-7b248375c6e8 req-5b6a0984-72c9-45c7-882d-efa31dda95ff service nova] Creating event network-vif-plugged:debb6e48-b9f6-494e-ae2b-d352ff3d6c73 for instance 16f49170-7caf-4e52-8328-d67867701796 on hv-cinder-85220 Aug 18 14:34:29.030010 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-6a3affef-f241-407b-9e6e-7b248375c6e8 req-5b6a0984-72c9-45c7-882d-efa31dda95ff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031780 Aug 18 14:34:29.030596 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 463/914] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:34:29.294108 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f1d1e20-d404-4b88-abc3-46249a06c6c1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:29.294753 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4f1d1e20-d404-4b88-abc3-46249a06c6c1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:29.301139 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1d1e20-d404-4b88-abc3-46249a06c6c1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:29.301620 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1d1e20-d404-4b88-abc3-46249a06c6c1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:29.302054 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1d1e20-d404-4b88-abc3-46249a06c6c1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:29.302738 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1d1e20-d404-4b88-abc3-46249a06c6c1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:29.303187 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1d1e20-d404-4b88-abc3-46249a06c6c1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:29.303643 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1d1e20-d404-4b88-abc3-46249a06c6c1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:29.437759 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4f1d1e20-d404-4b88-abc3-46249a06c6c1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:29.445445 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f1d1e20-d404-4b88-abc3-46249a06c6c1 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1266 microversion: 2.1 time: 0.155774 Aug 18 14:34:29.446003 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 452/915] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:29 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:30.472373 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-99310bc3-d274-45bb-8e9c-196a7f73e237 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:30.473088 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-99310bc3-d274-45bb-8e9c-196a7f73e237 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:30.480008 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99310bc3-d274-45bb-8e9c-196a7f73e237 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:30.480499 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99310bc3-d274-45bb-8e9c-196a7f73e237 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:30.480941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99310bc3-d274-45bb-8e9c-196a7f73e237 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:30.481637 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99310bc3-d274-45bb-8e9c-196a7f73e237 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:30.482097 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99310bc3-d274-45bb-8e9c-196a7f73e237 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:30.482528 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99310bc3-d274-45bb-8e9c-196a7f73e237 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:30.619706 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-99310bc3-d274-45bb-8e9c-196a7f73e237 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:30.627554 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-99310bc3-d274-45bb-8e9c-196a7f73e237 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1266 microversion: 2.1 time: 0.165104 Aug 18 14:34:30.628156 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 464/916] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:30 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:31.649354 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a326888f-b8f4-4956-980c-561de72e1ec3 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:31.650361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a326888f-b8f4-4956-980c-561de72e1ec3 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:31.663741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a326888f-b8f4-4956-980c-561de72e1ec3 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:31.664235 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a326888f-b8f4-4956-980c-561de72e1ec3 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:31.664704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a326888f-b8f4-4956-980c-561de72e1ec3 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:31.665412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a326888f-b8f4-4956-980c-561de72e1ec3 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:31.666382 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a326888f-b8f4-4956-980c-561de72e1ec3 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:31.666803 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a326888f-b8f4-4956-980c-561de72e1ec3 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:31.817623 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a326888f-b8f4-4956-980c-561de72e1ec3 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:31.825724 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a326888f-b8f4-4956-980c-561de72e1ec3 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1453 microversion: 2.1 time: 0.181202 Aug 18 14:34:31.826300 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 453/917] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:31 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:31.845764 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7393ee88-83c9-47e3-9662-34426f226b4c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:31.846385 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7393ee88-83c9-47e3-9662-34426f226b4c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:31.852737 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7393ee88-83c9-47e3-9662-34426f226b4c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:31.853743 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7393ee88-83c9-47e3-9662-34426f226b4c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:31.854177 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7393ee88-83c9-47e3-9662-34426f226b4c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:31.854858 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7393ee88-83c9-47e3-9662-34426f226b4c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:31.855334 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7393ee88-83c9-47e3-9662-34426f226b4c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:31.855776 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7393ee88-83c9-47e3-9662-34426f226b4c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:31.983941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7393ee88-83c9-47e3-9662-34426f226b4c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:34:31.991506 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7393ee88-83c9-47e3-9662-34426f226b4c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1453 microversion: 2.1 time: 0.149505 Aug 18 14:34:31.992067 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 465/918] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:34:31 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:34:33.649098 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-dae0a7bb-91f2-4876-aa48-1089ba064987 req-a8a5bf1b-22d0-45ca-8d5c-28224e1196fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16f49170-7caf-4e52-8328-d67867701796", "tag": "debb6e48-b9f6-494e-ae2b-d352ff3d6c73"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:34:33.659394 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-dae0a7bb-91f2-4876-aa48-1089ba064987 req-a8a5bf1b-22d0-45ca-8d5c-28224e1196fd service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:33.659950 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-dae0a7bb-91f2-4876-aa48-1089ba064987 req-a8a5bf1b-22d0-45ca-8d5c-28224e1196fd service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:33.660389 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-dae0a7bb-91f2-4876-aa48-1089ba064987 req-a8a5bf1b-22d0-45ca-8d5c-28224e1196fd service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:33.672336 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-dae0a7bb-91f2-4876-aa48-1089ba064987 req-a8a5bf1b-22d0-45ca-8d5c-28224e1196fd service nova] Creating event network-changed:debb6e48-b9f6-494e-ae2b-d352ff3d6c73 for instance 16f49170-7caf-4e52-8328-d67867701796 on hv-cinder-85220 Aug 18 14:34:33.677402 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-dae0a7bb-91f2-4876-aa48-1089ba064987 req-a8a5bf1b-22d0-45ca-8d5c-28224e1196fd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032362 Aug 18 14:34:33.678051 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 454/919] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:34:49.453320 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-206f9b58-260c-4cbb-b1c1-110fbb6e8dfa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:49.453839 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-206f9b58-260c-4cbb-b1c1-110fbb6e8dfa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:49.456295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=7 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:49.456943 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=19 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:49.463214 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-206f9b58-260c-4cbb-b1c1-110fbb6e8dfa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:49.463727 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-206f9b58-260c-4cbb-b1c1-110fbb6e8dfa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:49.464656 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-206f9b58-260c-4cbb-b1c1-110fbb6e8dfa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:49.465645 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-206f9b58-260c-4cbb-b1c1-110fbb6e8dfa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:49.466102 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-206f9b58-260c-4cbb-b1c1-110fbb6e8dfa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:49.466533 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-206f9b58-260c-4cbb-b1c1-110fbb6e8dfa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:49.491253 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-206f9b58-260c-4cbb-b1c1-110fbb6e8dfa tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/ips" status: 200 len: 145 microversion: 2.1 time: 0.042299 Aug 18 14:34:49.492134 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 466/920] 10.222.0.39 () {58 vars in 1248 bytes} [Thu Aug 18 14:34:49 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:34:50.831664 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=9 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:50.832392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=25 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:34:50.837487 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a0bfe3d-a49a-4da8-a19d-f6f81ff6ab1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66dc8aeb-8072-42bd-b3e2-eca8d2a72465"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:34:50.840683 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0a0bfe3d-a49a-4da8-a19d-f6f81ff6ab1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:50.847633 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a0bfe3d-a49a-4da8-a19d-f6f81ff6ab1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:50.848114 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a0bfe3d-a49a-4da8-a19d-f6f81ff6ab1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:50.848550 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a0bfe3d-a49a-4da8-a19d-f6f81ff6ab1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:50.849234 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a0bfe3d-a49a-4da8-a19d-f6f81ff6ab1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:50.849684 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a0bfe3d-a49a-4da8-a19d-f6f81ff6ab1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:50.850105 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a0bfe3d-a49a-4da8-a19d-f6f81ff6ab1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:51.085892 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a0bfe3d-a49a-4da8-a19d-f6f81ff6ab1c tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "POST /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255314 Aug 18 14:34:51.086498 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 455/921] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:34:50 2022] POST /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:34:57.545992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-31de816d-8d6a-452f-be6d-8c5511186f7e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:57.548161 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-31de816d-8d6a-452f-be6d-8c5511186f7e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:57.554174 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31de816d-8d6a-452f-be6d-8c5511186f7e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:57.554654 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31de816d-8d6a-452f-be6d-8c5511186f7e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:57.555084 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31de816d-8d6a-452f-be6d-8c5511186f7e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:57.555805 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31de816d-8d6a-452f-be6d-8c5511186f7e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:57.556265 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31de816d-8d6a-452f-be6d-8c5511186f7e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:57.556689 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31de816d-8d6a-452f-be6d-8c5511186f7e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:57.586053 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-31de816d-8d6a-452f-be6d-8c5511186f7e tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Aug 18 14:34:57.586632 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 467/922] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:34:57 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:34:57.598641 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-60bd9813-5882-4791-8761-65fac0a0c991 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:34:57.599225 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-60bd9813-5882-4791-8761-65fac0a0c991 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:57.606822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60bd9813-5882-4791-8761-65fac0a0c991 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:57.607308 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60bd9813-5882-4791-8761-65fac0a0c991 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:57.607775 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60bd9813-5882-4791-8761-65fac0a0c991 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:57.608478 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60bd9813-5882-4791-8761-65fac0a0c991 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:57.608935 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60bd9813-5882-4791-8761-65fac0a0c991 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:57.609363 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60bd9813-5882-4791-8761-65fac0a0c991 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:57.637186 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-60bd9813-5882-4791-8761-65fac0a0c991 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments/66dc8aeb-8072-42bd-b3e2-eca8d2a72465" status: 200 len: 194 microversion: 2.1 time: 0.042948 Aug 18 14:34:57.637756 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 456/923] 10.222.0.39 () {58 vars in 1413 bytes} [Thu Aug 18 14:34:57 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments/66dc8aeb-8072-42bd-b3e2-eca8d2a72465 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:34:58.958026 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fb55a3bd-7ff4-44b2-a12a-bad72bfa0764 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2440ef79-de2e-496f-af0b-5b5c5dcef06b"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:34:58.960374 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fb55a3bd-7ff4-44b2-a12a-bad72bfa0764 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:34:58.967944 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb55a3bd-7ff4-44b2-a12a-bad72bfa0764 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:58.968433 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb55a3bd-7ff4-44b2-a12a-bad72bfa0764 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:58.968873 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb55a3bd-7ff4-44b2-a12a-bad72bfa0764 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:58.969569 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb55a3bd-7ff4-44b2-a12a-bad72bfa0764 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:34:58.970027 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb55a3bd-7ff4-44b2-a12a-bad72bfa0764 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:34:58.970458 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb55a3bd-7ff4-44b2-a12a-bad72bfa0764 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:34:59.324427 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fb55a3bd-7ff4-44b2-a12a-bad72bfa0764 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "POST /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369485 Aug 18 14:34:59.325016 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 468/924] 10.222.0.39 () {60 vars in 1323 bytes} [Thu Aug 18 14:34:58 2022] POST /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:35:06.850173 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-72f70ade-e324-46f4-9053-7482ee35ec67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:06.852482 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-72f70ade-e324-46f4-9053-7482ee35ec67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:06.859878 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72f70ade-e324-46f4-9053-7482ee35ec67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:06.860356 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72f70ade-e324-46f4-9053-7482ee35ec67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:06.860791 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72f70ade-e324-46f4-9053-7482ee35ec67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:06.861480 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72f70ade-e324-46f4-9053-7482ee35ec67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:06.861931 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72f70ade-e324-46f4-9053-7482ee35ec67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:06.862353 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72f70ade-e324-46f4-9053-7482ee35ec67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:06.892578 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-72f70ade-e324-46f4-9053-7482ee35ec67 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046356 Aug 18 14:35:06.893123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 457/925] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:35:06 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:35:07.033838 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f627e05a-783f-4180-a4ba-f2e87a4f8592 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:07.034418 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f627e05a-783f-4180-a4ba-f2e87a4f8592 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:07.040562 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f627e05a-783f-4180-a4ba-f2e87a4f8592 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:07.041042 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f627e05a-783f-4180-a4ba-f2e87a4f8592 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:07.041478 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f627e05a-783f-4180-a4ba-f2e87a4f8592 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:07.042167 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f627e05a-783f-4180-a4ba-f2e87a4f8592 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:07.042621 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f627e05a-783f-4180-a4ba-f2e87a4f8592 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:07.043050 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f627e05a-783f-4180-a4ba-f2e87a4f8592 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:07.072135 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f627e05a-783f-4180-a4ba-f2e87a4f8592 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments/66dc8aeb-8072-42bd-b3e2-eca8d2a72465" status: 200 len: 194 microversion: 2.1 time: 0.043269 Aug 18 14:35:07.072714 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 469/926] 10.222.0.39 () {58 vars in 1413 bytes} [Thu Aug 18 14:35:07 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments/66dc8aeb-8072-42bd-b3e2-eca8d2a72465 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:35:07.082813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-35a3d123-fb37-4f01-bf41-c203144e18cd tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:07.083318 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-35a3d123-fb37-4f01-bf41-c203144e18cd tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:07.089540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35a3d123-fb37-4f01-bf41-c203144e18cd tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:07.090031 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35a3d123-fb37-4f01-bf41-c203144e18cd tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:07.090483 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35a3d123-fb37-4f01-bf41-c203144e18cd tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:07.091180 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35a3d123-fb37-4f01-bf41-c203144e18cd tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:07.091669 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35a3d123-fb37-4f01-bf41-c203144e18cd tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:07.092105 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35a3d123-fb37-4f01-bf41-c203144e18cd tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:07.230025 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-35a3d123-fb37-4f01-bf41-c203144e18cd tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lazy-loading 'services' on Instance uuid 7c5ad3c7-d8b1-4391-ad68-7191711e578b {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:35:07.304677 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-35a3d123-fb37-4f01-bf41-c203144e18cd tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments/66dc8aeb-8072-42bd-b3e2-eca8d2a72465" status: 202 len: 0 microversion: 2.1 time: 0.225598 Aug 18 14:35:07.305305 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 458/927] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Aug 18 14:35:07 2022] DELETE /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments/66dc8aeb-8072-42bd-b3e2-eca8d2a72465 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:35:08.426765 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a3d6f58b-3ff9-4344-aaf7-29808d83efb6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:08.427294 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a3d6f58b-3ff9-4344-aaf7-29808d83efb6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:08.433661 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d6f58b-3ff9-4344-aaf7-29808d83efb6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:08.434761 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d6f58b-3ff9-4344-aaf7-29808d83efb6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:08.435236 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d6f58b-3ff9-4344-aaf7-29808d83efb6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:08.435931 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d6f58b-3ff9-4344-aaf7-29808d83efb6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:08.436391 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d6f58b-3ff9-4344-aaf7-29808d83efb6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:08.436823 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d6f58b-3ff9-4344-aaf7-29808d83efb6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:08.465288 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a3d6f58b-3ff9-4344-aaf7-29808d83efb6 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments/2440ef79-de2e-496f-af0b-5b5c5dcef06b" status: 200 len: 194 microversion: 2.1 time: 0.042423 Aug 18 14:35:08.465917 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 470/928] 10.222.0.39 () {58 vars in 1413 bytes} [Thu Aug 18 14:35:08 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments/2440ef79-de2e-496f-af0b-5b5c5dcef06b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:35:08.477105 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8ce0ff32-d994-42d2-96df-c1456341f824 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:08.477684 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8ce0ff32-d994-42d2-96df-c1456341f824 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:08.484891 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ce0ff32-d994-42d2-96df-c1456341f824 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:08.485373 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ce0ff32-d994-42d2-96df-c1456341f824 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:08.485808 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ce0ff32-d994-42d2-96df-c1456341f824 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:08.486494 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ce0ff32-d994-42d2-96df-c1456341f824 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:08.486944 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ce0ff32-d994-42d2-96df-c1456341f824 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:08.487391 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ce0ff32-d994-42d2-96df-c1456341f824 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:08.566569 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-8ce0ff32-d994-42d2-96df-c1456341f824 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lazy-loading 'services' on Instance uuid 7c5ad3c7-d8b1-4391-ad68-7191711e578b {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:35:08.640722 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8ce0ff32-d994-42d2-96df-c1456341f824 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments/2440ef79-de2e-496f-af0b-5b5c5dcef06b" status: 202 len: 0 microversion: 2.1 time: 0.168289 Aug 18 14:35:08.641314 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 459/929] 10.222.0.39 () {58 vars in 1416 bytes} [Thu Aug 18 14:35:08 2022] DELETE /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments/2440ef79-de2e-496f-af0b-5b5c5dcef06b => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:35:09.808861 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-93d7e109-a305-4240-b806-32fbbc2062ed tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:09.811765 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-93d7e109-a305-4240-b806-32fbbc2062ed tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:09.818120 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93d7e109-a305-4240-b806-32fbbc2062ed tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:09.818602 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93d7e109-a305-4240-b806-32fbbc2062ed tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:09.819038 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93d7e109-a305-4240-b806-32fbbc2062ed tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:09.819754 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93d7e109-a305-4240-b806-32fbbc2062ed tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:09.820212 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93d7e109-a305-4240-b806-32fbbc2062ed tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:09.820636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93d7e109-a305-4240-b806-32fbbc2062ed tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:09.849452 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-93d7e109-a305-4240-b806-32fbbc2062ed tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044459 Aug 18 14:35:09.850001 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 471/930] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:35:09 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:35:09.962153 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fab782c2-dae2-47c0-a680-a1373c69ba45 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:09.964499 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fab782c2-dae2-47c0-a680-a1373c69ba45 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:09.970855 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fab782c2-dae2-47c0-a680-a1373c69ba45 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:09.971346 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fab782c2-dae2-47c0-a680-a1373c69ba45 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:09.971813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fab782c2-dae2-47c0-a680-a1373c69ba45 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:09.972511 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fab782c2-dae2-47c0-a680-a1373c69ba45 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:09.972971 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fab782c2-dae2-47c0-a680-a1373c69ba45 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:09.973403 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fab782c2-dae2-47c0-a680-a1373c69ba45 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:10.004830 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fab782c2-dae2-47c0-a680-a1373c69ba45 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047747 Aug 18 14:35:10.005392 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 460/931] 10.222.0.39 () {58 vars in 1302 bytes} [Thu Aug 18 14:35:09 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 14:35:10.069180 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2b420bdb-771c-46c4-a227-10e564318556 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:10.069681 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2b420bdb-771c-46c4-a227-10e564318556 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:10.075652 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b420bdb-771c-46c4-a227-10e564318556 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:10.076132 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b420bdb-771c-46c4-a227-10e564318556 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:10.076563 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b420bdb-771c-46c4-a227-10e564318556 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:10.077243 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b420bdb-771c-46c4-a227-10e564318556 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:10.077692 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b420bdb-771c-46c4-a227-10e564318556 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:10.078110 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b420bdb-771c-46c4-a227-10e564318556 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:10.102727 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2b420bdb-771c-46c4-a227-10e564318556 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:35:10.176590 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2b420bdb-771c-46c4-a227-10e564318556 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 204 len: 0 microversion: 2.1 time: 0.110850 Aug 18 14:35:10.177036 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 472/932] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:35:10 2022] DELETE /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:35:10.187985 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d67bd3a-a184-4a90-bedc-ad22e9b89ab3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:10.188603 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7d67bd3a-a184-4a90-bedc-ad22e9b89ab3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:10.194791 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d67bd3a-a184-4a90-bedc-ad22e9b89ab3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:10.195280 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d67bd3a-a184-4a90-bedc-ad22e9b89ab3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:10.196001 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d67bd3a-a184-4a90-bedc-ad22e9b89ab3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:10.196696 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d67bd3a-a184-4a90-bedc-ad22e9b89ab3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:10.197152 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d67bd3a-a184-4a90-bedc-ad22e9b89ab3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:10.197577 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d67bd3a-a184-4a90-bedc-ad22e9b89ab3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:10.332336 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7d67bd3a-a184-4a90-bedc-ad22e9b89ab3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:10.340935 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d67bd3a-a184-4a90-bedc-ad22e9b89ab3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 200 len: 1673 microversion: 2.1 time: 0.158957 Aug 18 14:35:10.341504 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 461/933] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:10 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:35:11.363585 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8c394f7c-0a5b-4f9c-ac4a-cb26aca870ce tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:11.364297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8c394f7c-0a5b-4f9c-ac4a-cb26aca870ce tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:11.370702 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c394f7c-0a5b-4f9c-ac4a-cb26aca870ce tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:11.371186 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c394f7c-0a5b-4f9c-ac4a-cb26aca870ce tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:11.372387 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c394f7c-0a5b-4f9c-ac4a-cb26aca870ce tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:11.372994 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c394f7c-0a5b-4f9c-ac4a-cb26aca870ce tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:11.373447 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c394f7c-0a5b-4f9c-ac4a-cb26aca870ce tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:11.373877 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c394f7c-0a5b-4f9c-ac4a-cb26aca870ce tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:11.505853 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8c394f7c-0a5b-4f9c-ac4a-cb26aca870ce tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:11.513816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8c394f7c-0a5b-4f9c-ac4a-cb26aca870ce tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 200 len: 1673 microversion: 2.1 time: 0.154488 Aug 18 14:35:11.514370 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 473/934] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:11 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:35:12.534331 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0ea358a1-7791-4b2b-b26a-1bc48a25c13d tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:12.534962 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0ea358a1-7791-4b2b-b26a-1bc48a25c13d tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:12.541384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ea358a1-7791-4b2b-b26a-1bc48a25c13d tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:12.541869 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ea358a1-7791-4b2b-b26a-1bc48a25c13d tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:12.542312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ea358a1-7791-4b2b-b26a-1bc48a25c13d tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:12.543008 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ea358a1-7791-4b2b-b26a-1bc48a25c13d tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:12.543495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ea358a1-7791-4b2b-b26a-1bc48a25c13d tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:12.543928 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ea358a1-7791-4b2b-b26a-1bc48a25c13d tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:12.613436 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0ea358a1-7791-4b2b-b26a-1bc48a25c13d tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660aa77ae39a47e8b3b607d0839ed3dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3936135be542a4a1e0370bac465278', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:12.621206 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0ea358a1-7791-4b2b-b26a-1bc48a25c13d tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 200 len: 1606 microversion: 2.1 time: 0.090860 Aug 18 14:35:12.621786 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 462/935] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:12 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 1606 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:35:12.726117 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-7c62899f-3f0a-4d03-a3e5-8d5e4f68129e req-4b790528-4321-43b2-aa38-37a050afffab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c5ad3c7-d8b1-4391-ad68-7191711e578b", "name": "network-vif-deleted", "tag": "f126f3db-a078-45d3-a8ad-f75ce982a16a"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:35:12.738663 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-7c62899f-3f0a-4d03-a3e5-8d5e4f68129e req-4b790528-4321-43b2-aa38-37a050afffab service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:12.739407 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-7c62899f-3f0a-4d03-a3e5-8d5e4f68129e req-4b790528-4321-43b2-aa38-37a050afffab service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:12.740020 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-7c62899f-3f0a-4d03-a3e5-8d5e4f68129e req-4b790528-4321-43b2-aa38-37a050afffab service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:12.753217 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-7c62899f-3f0a-4d03-a3e5-8d5e4f68129e req-4b790528-4321-43b2-aa38-37a050afffab service nova] Creating event network-vif-deleted:f126f3db-a078-45d3-a8ad-f75ce982a16a for instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b on hv-cinder-85220 Aug 18 14:35:12.758199 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-7c62899f-3f0a-4d03-a3e5-8d5e4f68129e req-4b790528-4321-43b2-aa38-37a050afffab service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035873 Aug 18 14:35:12.758837 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 474/936] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:35:13.642723 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3452dab9-f8d0-420d-99e4-c00bca874af1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:13.643485 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3452dab9-f8d0-420d-99e4-c00bca874af1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:13.650058 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3452dab9-f8d0-420d-99e4-c00bca874af1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:13.650554 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3452dab9-f8d0-420d-99e4-c00bca874af1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:13.650993 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3452dab9-f8d0-420d-99e4-c00bca874af1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:13.651797 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3452dab9-f8d0-420d-99e4-c00bca874af1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:13.652252 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3452dab9-f8d0-420d-99e4-c00bca874af1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:13.652683 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3452dab9-f8d0-420d-99e4-c00bca874af1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:13.667671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-3452dab9-f8d0-420d-99e4-c00bca874af1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] HTTP exception thrown: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3452dab9-f8d0-420d-99e4-c00bca874af1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Request method failure captured: Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b HTTP/1.1 Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_k0S-eQbRWCc5BXphExm5Ld5x_jGf8-cDqOv4se9AarEyEn1fZIwBVqJVR0HFHwUhy2SKdqrxKavj6imhbf7PZAXn59ukzUsKgJNcsf-t3Fjk5MV_An8oRF2PbTH4yWi-u72656ZiMsho9HcpnFkzfDiB5Idtx6jl5788onGbd4rsxc Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: ac3936135be542a4a1e0370bac465278 Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:35:13.669523 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:35:13.671393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac3936135be542a4a1e0370bac465278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac3936135be542a4a1e0370bac465278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac3936135be542a4a1e0370bac465278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac3936135be542a4a1e0370bac465278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:35:13.671393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:13.671393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: ac3936135be542a4a1e0370bac465278 Aug 18 14:35:13.671393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:13.671393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeTestJSON-805751942-project Aug 18 14:35:13.671393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:35:13.671393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:35:13.671393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 660aa77ae39a47e8b3b607d0839ed3dc Aug 18 14:35:13.671393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeTestJSON-805751942-project Aug 18 14:35:13.671393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:35:13.671393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:13.671393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '7c5ad3c7-d8b1-4391-ad68-7191711e578b'} Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:35:13.675835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:13.677466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:13.678882 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3452dab9-f8d0-420d-99e4-c00bca874af1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Returning 404 to user: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:35:13.678882 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3452dab9-f8d0-420d-99e4-c00bca874af1 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 404 len: 111 microversion: 2.1 time: 0.032201 Aug 18 14:35:13.678882 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 463/937] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:13 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:35:13.680931 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-34263b43-d85a-4aff-ae33-7fa96c22e2b3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '.version_select at 0x7fb6221a6a60>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:13.701148 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-34263b43-d85a-4aff-ae33-7fa96c22e2b3 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1167815893" status: 202 len: 0 microversion: 2.1 time: 0.024475 Aug 18 14:35:13.701943 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 475/938] 10.222.0.39 () {58 vars in 1221 bytes} [Thu Aug 18 14:35:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1167815893 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:35:16.608723 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3d814b0c-fd9c-4e03-81f4-d5368dd0dfa0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:16.609228 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3d814b0c-fd9c-4e03-81f4-d5368dd0dfa0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:16.615709 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d814b0c-fd9c-4e03-81f4-d5368dd0dfa0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:16.616192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d814b0c-fd9c-4e03-81f4-d5368dd0dfa0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:16.616634 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d814b0c-fd9c-4e03-81f4-d5368dd0dfa0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:16.617345 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d814b0c-fd9c-4e03-81f4-d5368dd0dfa0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:16.617805 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d814b0c-fd9c-4e03-81f4-d5368dd0dfa0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:16.618235 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d814b0c-fd9c-4e03-81f4-d5368dd0dfa0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:16.632560 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-3d814b0c-fd9c-4e03-81f4-d5368dd0dfa0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] HTTP exception thrown: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3d814b0c-fd9c-4e03-81f4-d5368dd0dfa0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Request method failure captured: Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b HTTP/1.1 Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_k0S-eQbRWCc5BXphExm5Ld5x_jGf8-cDqOv4se9AarEyEn1fZIwBVqJVR0HFHwUhy2SKdqrxKavj6imhbf7PZAXn59ukzUsKgJNcsf-t3Fjk5MV_An8oRF2PbTH4yWi-u72656ZiMsho9HcpnFkzfDiB5Idtx6jl5788onGbd4rsxc Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: ac3936135be542a4a1e0370bac465278 Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:35:16.634151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:35:16.635596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac3936135be542a4a1e0370bac465278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac3936135be542a4a1e0370bac465278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac3936135be542a4a1e0370bac465278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac3936135be542a4a1e0370bac465278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:35:16.635596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:16.635596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: ac3936135be542a4a1e0370bac465278 Aug 18 14:35:16.635596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:16.635596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeTestJSON-805751942-project Aug 18 14:35:16.635596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:35:16.635596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:35:16.635596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 660aa77ae39a47e8b3b607d0839ed3dc Aug 18 14:35:16.635596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeTestJSON-805751942-project Aug 18 14:35:16.635596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:35:16.635596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:16.635596 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '7c5ad3c7-d8b1-4391-ad68-7191711e578b'} Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:35:16.636376 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:16.638618 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:16.641259 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3d814b0c-fd9c-4e03-81f4-d5368dd0dfa0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Returning 404 to user: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:35:16.641259 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3d814b0c-fd9c-4e03-81f4-d5368dd0dfa0 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 404 len: 111 microversion: 2.1 time: 0.031032 Aug 18 14:35:16.641259 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 464/939] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:35:16 2022] DELETE /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:35:16.645088 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2ff4b26a-abc2-4726-8268-c3b96c439b61 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:16.645834 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2ff4b26a-abc2-4726-8268-c3b96c439b61 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 7c5ad3c7-d8b1-4391-ad68-7191711e578b] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:16.652458 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ff4b26a-abc2-4726-8268-c3b96c439b61 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:16.653616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ff4b26a-abc2-4726-8268-c3b96c439b61 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:16.654057 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ff4b26a-abc2-4726-8268-c3b96c439b61 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:16.654843 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ff4b26a-abc2-4726-8268-c3b96c439b61 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:16.655302 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ff4b26a-abc2-4726-8268-c3b96c439b61 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:16.655764 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ff4b26a-abc2-4726-8268-c3b96c439b61 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:16.669344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-2ff4b26a-abc2-4726-8268-c3b96c439b61 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] HTTP exception thrown: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2ff4b26a-abc2-4726-8268-c3b96c439b61 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Request method failure captured: Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b HTTP/1.1 Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_k0S-eQbRWCc5BXphExm5Ld5x_jGf8-cDqOv4se9AarEyEn1fZIwBVqJVR0HFHwUhy2SKdqrxKavj6imhbf7PZAXn59ukzUsKgJNcsf-t3Fjk5MV_An8oRF2PbTH4yWi-u72656ZiMsho9HcpnFkzfDiB5Idtx6jl5788onGbd4rsxc Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: ac3936135be542a4a1e0370bac465278 Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:35:16.670989 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:35:16.672532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac3936135be542a4a1e0370bac465278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac3936135be542a4a1e0370bac465278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac3936135be542a4a1e0370bac465278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac3936135be542a4a1e0370bac465278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:35:16.672532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:16.672532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: ac3936135be542a4a1e0370bac465278 Aug 18 14:35:16.672532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:16.672532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeTestJSON-805751942-project Aug 18 14:35:16.672532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:35:16.672532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:35:16.672532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 660aa77ae39a47e8b3b607d0839ed3dc Aug 18 14:35:16.672532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeTestJSON-805751942-project Aug 18 14:35:16.672532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:35:16.672532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:16.672532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '7c5ad3c7-d8b1-4391-ad68-7191711e578b'} Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:35:16.673347 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. Aug 18 14:35:16.674970 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:16.676577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2ff4b26a-abc2-4726-8268-c3b96c439b61 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Returning 404 to user: Instance 7c5ad3c7-d8b1-4391-ad68-7191711e578b could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:35:16.676577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2ff4b26a-abc2-4726-8268-c3b96c439b61 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b" status: 404 len: 111 microversion: 2.1 time: 0.031813 Aug 18 14:35:16.676577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 476/940] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:16 2022] GET /compute/v2.1/servers/7c5ad3c7-d8b1-4391-ad68-7191711e578b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:35:17.818018 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5b0ae64d-35cf-4b7a-8859-1192e4704dc4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:17.818528 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5b0ae64d-35cf-4b7a-8859-1192e4704dc4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:17.825158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b0ae64d-35cf-4b7a-8859-1192e4704dc4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:17.825686 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b0ae64d-35cf-4b7a-8859-1192e4704dc4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:17.826154 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b0ae64d-35cf-4b7a-8859-1192e4704dc4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:17.826872 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b0ae64d-35cf-4b7a-8859-1192e4704dc4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:17.827335 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b0ae64d-35cf-4b7a-8859-1192e4704dc4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:17.827973 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b0ae64d-35cf-4b7a-8859-1192e4704dc4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:17.843151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-5b0ae64d-35cf-4b7a-8859-1192e4704dc4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] HTTP exception thrown: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5b0ae64d-35cf-4b7a-8859-1192e4704dc4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Request method failure captured: Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 HTTP/1.1 Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_k0S-eQbRWCc5BXphExm5Ld5x_jGf8-cDqOv4se9AarEyEn1fZIwBVqJVR0HFHwUhy2SKdqrxKavj6imhbf7PZAXn59ukzUsKgJNcsf-t3Fjk5MV_An8oRF2PbTH4yWi-u72656ZiMsho9HcpnFkzfDiB5Idtx6jl5788onGbd4rsxc Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: ac3936135be542a4a1e0370bac465278 Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:35:17.844741 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:35:17.846341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac3936135be542a4a1e0370bac465278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac3936135be542a4a1e0370bac465278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac3936135be542a4a1e0370bac465278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac3936135be542a4a1e0370bac465278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:35:17.846341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:17.846341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: ac3936135be542a4a1e0370bac465278 Aug 18 14:35:17.846341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:17.846341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeTestJSON-805751942-project Aug 18 14:35:17.846341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:35:17.846341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:35:17.846341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 660aa77ae39a47e8b3b607d0839ed3dc Aug 18 14:35:17.846341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeTestJSON-805751942-project Aug 18 14:35:17.846341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:35:17.846341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:35:17.846341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '14e298a2-722b-4340-a4cc-7b5cf8596c17'} Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:35:17.847239 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:35:17.848798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:35:17.850306 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5b0ae64d-35cf-4b7a-8859-1192e4704dc4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Returning 404 to user: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:35:17.850306 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5b0ae64d-35cf-4b7a-8859-1192e4704dc4 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "DELETE /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 404 len: 111 microversion: 2.1 time: 0.032029 Aug 18 14:35:17.850306 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 465/941] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:35:17 2022] DELETE /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:35:17.855305 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c8eb7d02-8db0-4245-82b5-5098497e9236 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:17.856609 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c8eb7d02-8db0-4245-82b5-5098497e9236 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] [instance: 14e298a2-722b-4340-a4cc-7b5cf8596c17] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:17.863155 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8eb7d02-8db0-4245-82b5-5098497e9236 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:17.863679 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8eb7d02-8db0-4245-82b5-5098497e9236 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:17.864118 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8eb7d02-8db0-4245-82b5-5098497e9236 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:17.864811 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8eb7d02-8db0-4245-82b5-5098497e9236 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:17.865266 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8eb7d02-8db0-4245-82b5-5098497e9236 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:17.865690 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8eb7d02-8db0-4245-82b5-5098497e9236 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:17.878871 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-c8eb7d02-8db0-4245-82b5-5098497e9236 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] HTTP exception thrown: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c8eb7d02-8db0-4245-82b5-5098497e9236 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Request method failure captured: Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 HTTP/1.1 Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_k0S-eQbRWCc5BXphExm5Ld5x_jGf8-cDqOv4se9AarEyEn1fZIwBVqJVR0HFHwUhy2SKdqrxKavj6imhbf7PZAXn59ukzUsKgJNcsf-t3Fjk5MV_An8oRF2PbTH4yWi-u72656ZiMsho9HcpnFkzfDiB5Idtx6jl5788onGbd4rsxc Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: ac3936135be542a4a1e0370bac465278 Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:35:17.880403 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:35:17.882013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac3936135be542a4a1e0370bac465278"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac3936135be542a4a1e0370bac465278"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac3936135be542a4a1e0370bac465278"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac3936135be542a4a1e0370bac465278"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:35:17.882013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:17.882013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: ac3936135be542a4a1e0370bac465278 Aug 18 14:35:17.882013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeTestJSON-805751942 Aug 18 14:35:17.882013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeTestJSON-805751942-project Aug 18 14:35:17.882013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:35:17.882013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:35:17.882013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 660aa77ae39a47e8b3b607d0839ed3dc Aug 18 14:35:17.882013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeTestJSON-805751942-project Aug 18 14:35:17.882013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:35:17.882013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:35:17.882013 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '14e298a2-722b-4340-a4cc-7b5cf8596c17'} Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:35:17.882816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. Aug 18 14:35:17.884076 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:17.885170 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c8eb7d02-8db0-4245-82b5-5098497e9236 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] Returning 404 to user: Instance 14e298a2-722b-4340-a4cc-7b5cf8596c17 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:35:17.885170 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c8eb7d02-8db0-4245-82b5-5098497e9236 tempest-AttachVolumeTestJSON-805751942 tempest-AttachVolumeTestJSON-805751942-project] 10.222.0.39 "GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17" status: 404 len: 111 microversion: 2.1 time: 0.030408 Aug 18 14:35:17.885170 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 477/942] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:17 2022] GET /compute/v2.1/servers/14e298a2-722b-4340-a4cc-7b5cf8596c17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:35:45.912734 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-31191038", "imageRef": "b8a4a802-9933-46a9-8013-0d79b01dc8ba", "flavorRef": "452"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:35:45.919921 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=22 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:35:45.920571 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:35:45.966797 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] validate_networks() for None {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:35:46.237207 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:35:46.238321 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:35:46.238810 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:35:46.239251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:35:46.239751 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:35:46.248730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:46.249209 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:46.249647 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:46.250375 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:46.250829 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:46.251256 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:46.269256 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Getting quotas for project 2381d626c4ac4228b893873ccaf0f23a. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:35:46.273238 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Getting quotas for user d802764869c14db0b94ed8def1b12606 and project 2381d626c4ac4228b893873ccaf0f23a. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:35:46.284151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:35:46.286576 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b8a4a802-9933-46a9-8013-0d79b01dc8ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:35:46.332463 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e8a606ce-6545-4e12-8030-fa1ee90738af tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.424243 Aug 18 14:35:46.333316 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 466/943] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:35:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:35:46.344750 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-41de8510-0c29-4604-aec1-c37f1bf54b5a tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:46.345369 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-41de8510-0c29-4604-aec1-c37f1bf54b5a tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:46.348552 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:35:46.349197 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:35:46.408285 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-41de8510-0c29-4604-aec1-c37f1bf54b5a tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802764869c14db0b94ed8def1b12606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2381d626c4ac4228b893873ccaf0f23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:46.415852 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-41de8510-0c29-4604-aec1-c37f1bf54b5a tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 200 len: 1213 microversion: 2.1 time: 0.074849 Aug 18 14:35:46.416423 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 478/944] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:46 2022] GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:35:47.444482 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e73c2d0b-2079-4638-891c-3576e76b19de tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:47.444482 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e73c2d0b-2079-4638-891c-3576e76b19de tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:47.451876 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e73c2d0b-2079-4638-891c-3576e76b19de tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:47.452373 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e73c2d0b-2079-4638-891c-3576e76b19de tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:47.452812 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e73c2d0b-2079-4638-891c-3576e76b19de tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:47.453730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e73c2d0b-2079-4638-891c-3576e76b19de tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:47.454191 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e73c2d0b-2079-4638-891c-3576e76b19de tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:47.454637 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e73c2d0b-2079-4638-891c-3576e76b19de tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:47.523954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e73c2d0b-2079-4638-891c-3576e76b19de tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802764869c14db0b94ed8def1b12606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2381d626c4ac4228b893873ccaf0f23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:47.531814 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e73c2d0b-2079-4638-891c-3576e76b19de tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 200 len: 1283 microversion: 2.1 time: 0.093307 Aug 18 14:35:47.532475 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 467/945] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:47 2022] GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 1283 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:35:48.553349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d184c665-803e-4617-9a70-19c045a78a06 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:48.554000 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d184c665-803e-4617-9a70-19c045a78a06 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:48.562931 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d184c665-803e-4617-9a70-19c045a78a06 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:48.563435 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d184c665-803e-4617-9a70-19c045a78a06 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:48.563869 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d184c665-803e-4617-9a70-19c045a78a06 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:48.564557 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d184c665-803e-4617-9a70-19c045a78a06 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:48.565536 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d184c665-803e-4617-9a70-19c045a78a06 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:48.566186 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d184c665-803e-4617-9a70-19c045a78a06 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:48.760903 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d184c665-803e-4617-9a70-19c045a78a06 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802764869c14db0b94ed8def1b12606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2381d626c4ac4228b893873ccaf0f23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:48.769461 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d184c665-803e-4617-9a70-19c045a78a06 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 200 len: 1313 microversion: 2.1 time: 0.220266 Aug 18 14:35:48.770043 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 479/946] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:48 2022] GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:35:49.099635 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-0ed53387-1f0b-47ff-9881-e0be7bfb1999 req-ba4130f3-9cef-4ef7-894e-9f517ce9f62d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a656c71-8840-4f45-b0ff-6f54a618f771", "tag": "7378a5b9-aba6-4eb2-b563-cf7e03880c2e"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:35:49.109034 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0ed53387-1f0b-47ff-9881-e0be7bfb1999 req-ba4130f3-9cef-4ef7-894e-9f517ce9f62d service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:49.109516 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0ed53387-1f0b-47ff-9881-e0be7bfb1999 req-ba4130f3-9cef-4ef7-894e-9f517ce9f62d service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:49.109952 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0ed53387-1f0b-47ff-9881-e0be7bfb1999 req-ba4130f3-9cef-4ef7-894e-9f517ce9f62d service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:49.121127 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-0ed53387-1f0b-47ff-9881-e0be7bfb1999 req-ba4130f3-9cef-4ef7-894e-9f517ce9f62d service nova] Creating event network-changed:7378a5b9-aba6-4eb2-b563-cf7e03880c2e for instance 0a656c71-8840-4f45-b0ff-6f54a618f771 on hv-cinder-85220 Aug 18 14:35:49.125995 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-0ed53387-1f0b-47ff-9881-e0be7bfb1999 req-ba4130f3-9cef-4ef7-894e-9f517ce9f62d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152789 Aug 18 14:35:49.126594 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 468/947] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:35:49.790935 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d64b02e4-1e2a-4d2a-9f5b-2c78ca347879 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:49.791516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d64b02e4-1e2a-4d2a-9f5b-2c78ca347879 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:49.797903 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d64b02e4-1e2a-4d2a-9f5b-2c78ca347879 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:49.798389 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d64b02e4-1e2a-4d2a-9f5b-2c78ca347879 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:49.798823 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d64b02e4-1e2a-4d2a-9f5b-2c78ca347879 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:49.800322 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d64b02e4-1e2a-4d2a-9f5b-2c78ca347879 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:49.801118 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d64b02e4-1e2a-4d2a-9f5b-2c78ca347879 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:49.801814 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d64b02e4-1e2a-4d2a-9f5b-2c78ca347879 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:49.938190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d64b02e4-1e2a-4d2a-9f5b-2c78ca347879 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802764869c14db0b94ed8def1b12606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2381d626c4ac4228b893873ccaf0f23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:49.947152 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d64b02e4-1e2a-4d2a-9f5b-2c78ca347879 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 200 len: 1313 microversion: 2.1 time: 0.160089 Aug 18 14:35:49.947750 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 480/948] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:49 2022] GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:35:50.969076 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-24bc190a-6a5b-4b66-8436-62da242031f2 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:50.969697 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-24bc190a-6a5b-4b66-8436-62da242031f2 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:50.975973 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24bc190a-6a5b-4b66-8436-62da242031f2 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:50.976455 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24bc190a-6a5b-4b66-8436-62da242031f2 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:50.976889 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24bc190a-6a5b-4b66-8436-62da242031f2 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:50.977581 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24bc190a-6a5b-4b66-8436-62da242031f2 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:50.978035 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24bc190a-6a5b-4b66-8436-62da242031f2 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:50.978461 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24bc190a-6a5b-4b66-8436-62da242031f2 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:51.119563 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-24bc190a-6a5b-4b66-8436-62da242031f2 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802764869c14db0b94ed8def1b12606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2381d626c4ac4228b893873ccaf0f23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:51.127220 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-24bc190a-6a5b-4b66-8436-62da242031f2 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 200 len: 1313 microversion: 2.1 time: 0.162859 Aug 18 14:35:51.128713 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 469/949] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:50 2022] GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:35:52.149587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eeae539c-902a-4d9d-9372-5e49db322ba0 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:52.150250 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eeae539c-902a-4d9d-9372-5e49db322ba0 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:52.156633 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eeae539c-902a-4d9d-9372-5e49db322ba0 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:52.157120 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eeae539c-902a-4d9d-9372-5e49db322ba0 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:52.157561 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eeae539c-902a-4d9d-9372-5e49db322ba0 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:52.158253 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eeae539c-902a-4d9d-9372-5e49db322ba0 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:52.158756 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eeae539c-902a-4d9d-9372-5e49db322ba0 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:52.159257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eeae539c-902a-4d9d-9372-5e49db322ba0 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:52.289518 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-eeae539c-902a-4d9d-9372-5e49db322ba0 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802764869c14db0b94ed8def1b12606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2381d626c4ac4228b893873ccaf0f23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:52.297056 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eeae539c-902a-4d9d-9372-5e49db322ba0 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 200 len: 1313 microversion: 2.1 time: 0.151471 Aug 18 14:35:52.297621 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 481/950] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:52 2022] GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:35:53.318102 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c6ee6877-caa8-4d11-9a28-e38350eb4471 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:53.318736 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c6ee6877-caa8-4d11-9a28-e38350eb4471 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:53.325549 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6ee6877-caa8-4d11-9a28-e38350eb4471 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:53.326061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6ee6877-caa8-4d11-9a28-e38350eb4471 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:53.326496 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6ee6877-caa8-4d11-9a28-e38350eb4471 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:53.327190 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6ee6877-caa8-4d11-9a28-e38350eb4471 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:53.327674 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6ee6877-caa8-4d11-9a28-e38350eb4471 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:53.328097 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6ee6877-caa8-4d11-9a28-e38350eb4471 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:53.466819 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c6ee6877-caa8-4d11-9a28-e38350eb4471 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802764869c14db0b94ed8def1b12606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2381d626c4ac4228b893873ccaf0f23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:53.474578 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c6ee6877-caa8-4d11-9a28-e38350eb4471 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 200 len: 1313 microversion: 2.1 time: 0.160366 Aug 18 14:35:53.475138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 470/951] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:53 2022] GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:35:54.495479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-39bd0ce5-1f0a-40fe-87a1-30ae03222598 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:54.496099 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-39bd0ce5-1f0a-40fe-87a1-30ae03222598 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:54.502525 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39bd0ce5-1f0a-40fe-87a1-30ae03222598 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:54.503011 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39bd0ce5-1f0a-40fe-87a1-30ae03222598 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:54.503472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39bd0ce5-1f0a-40fe-87a1-30ae03222598 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:54.504669 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39bd0ce5-1f0a-40fe-87a1-30ae03222598 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:54.505134 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39bd0ce5-1f0a-40fe-87a1-30ae03222598 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:54.505551 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39bd0ce5-1f0a-40fe-87a1-30ae03222598 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:54.634761 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-39bd0ce5-1f0a-40fe-87a1-30ae03222598 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802764869c14db0b94ed8def1b12606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2381d626c4ac4228b893873ccaf0f23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:54.642441 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-39bd0ce5-1f0a-40fe-87a1-30ae03222598 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 200 len: 1313 microversion: 2.1 time: 0.150873 Aug 18 14:35:54.643005 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 482/952] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:54 2022] GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:35:55.420985 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-b82921de-5681-4941-993b-562d3fef16f5 req-219ba5da-a699-4a22-ab9f-0ecbb7e7c673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a656c71-8840-4f45-b0ff-6f54a618f771", "name": "network-vif-plugged", "status": "completed", "tag": "7378a5b9-aba6-4eb2-b563-cf7e03880c2e"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:35:55.432111 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b82921de-5681-4941-993b-562d3fef16f5 req-219ba5da-a699-4a22-ab9f-0ecbb7e7c673 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:55.432646 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b82921de-5681-4941-993b-562d3fef16f5 req-219ba5da-a699-4a22-ab9f-0ecbb7e7c673 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:55.433147 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b82921de-5681-4941-993b-562d3fef16f5 req-219ba5da-a699-4a22-ab9f-0ecbb7e7c673 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:55.444643 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-b82921de-5681-4941-993b-562d3fef16f5 req-219ba5da-a699-4a22-ab9f-0ecbb7e7c673 service nova] Creating event network-vif-plugged:7378a5b9-aba6-4eb2-b563-cf7e03880c2e for instance 0a656c71-8840-4f45-b0ff-6f54a618f771 on hv-cinder-85220 Aug 18 14:35:55.449886 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-b82921de-5681-4941-993b-562d3fef16f5 req-219ba5da-a699-4a22-ab9f-0ecbb7e7c673 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092397 Aug 18 14:35:55.450485 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 471/953] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:35:55.665755 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3be2e85b-70c7-4117-afc8-4d36259188d7 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:55.666496 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3be2e85b-70c7-4117-afc8-4d36259188d7 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:55.674012 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3be2e85b-70c7-4117-afc8-4d36259188d7 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:55.674502 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3be2e85b-70c7-4117-afc8-4d36259188d7 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:55.674949 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3be2e85b-70c7-4117-afc8-4d36259188d7 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:55.675674 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3be2e85b-70c7-4117-afc8-4d36259188d7 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:55.676134 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3be2e85b-70c7-4117-afc8-4d36259188d7 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:55.676569 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3be2e85b-70c7-4117-afc8-4d36259188d7 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:55.814008 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3be2e85b-70c7-4117-afc8-4d36259188d7 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802764869c14db0b94ed8def1b12606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2381d626c4ac4228b893873ccaf0f23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:55.822239 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3be2e85b-70c7-4117-afc8-4d36259188d7 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 200 len: 1313 microversion: 2.1 time: 0.162386 Aug 18 14:35:55.822810 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 483/954] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:55 2022] GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:35:56.843532 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bdb8e403-95c8-4174-a5f0-77d92ed04191 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:56.844233 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bdb8e403-95c8-4174-a5f0-77d92ed04191 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:56.846158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:35:56.846818 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:35:56.853361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb8e403-95c8-4174-a5f0-77d92ed04191 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:56.853857 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb8e403-95c8-4174-a5f0-77d92ed04191 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:56.854329 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb8e403-95c8-4174-a5f0-77d92ed04191 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:56.855037 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb8e403-95c8-4174-a5f0-77d92ed04191 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:56.855527 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb8e403-95c8-4174-a5f0-77d92ed04191 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:56.855958 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb8e403-95c8-4174-a5f0-77d92ed04191 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:56.993312 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bdb8e403-95c8-4174-a5f0-77d92ed04191 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802764869c14db0b94ed8def1b12606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2381d626c4ac4228b893873ccaf0f23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:57.003704 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bdb8e403-95c8-4174-a5f0-77d92ed04191 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 200 len: 1463 microversion: 2.1 time: 0.164224 Aug 18 14:35:57.005153 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 472/955] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:56 2022] GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 1463 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:35:57.051487 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b8e4c5a2-3e9e-4edc-9c0b-1dcf8183ee12 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:57.052472 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b8e4c5a2-3e9e-4edc-9c0b-1dcf8183ee12 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:57.054360 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:35:57.059973 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e4c5a2-3e9e-4edc-9c0b-1dcf8183ee12 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:57.060467 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e4c5a2-3e9e-4edc-9c0b-1dcf8183ee12 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:57.060900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e4c5a2-3e9e-4edc-9c0b-1dcf8183ee12 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:57.061598 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e4c5a2-3e9e-4edc-9c0b-1dcf8183ee12 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:57.062060 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e4c5a2-3e9e-4edc-9c0b-1dcf8183ee12 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:57.062485 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e4c5a2-3e9e-4edc-9c0b-1dcf8183ee12 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:57.088602 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b8e4c5a2-3e9e-4edc-9c0b-1dcf8183ee12 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:35:57.169861 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b8e4c5a2-3e9e-4edc-9c0b-1dcf8183ee12 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 204 len: 0 microversion: 2.1 time: 0.123114 Aug 18 14:35:57.170439 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 484/956] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:35:57 2022] DELETE /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:35:57.179414 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d99fbb8e-736e-4bf0-a0e5-34826bd6bc70 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:57.180040 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d99fbb8e-736e-4bf0-a0e5-34826bd6bc70 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:57.185999 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d99fbb8e-736e-4bf0-a0e5-34826bd6bc70 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:57.186491 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d99fbb8e-736e-4bf0-a0e5-34826bd6bc70 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:57.186985 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d99fbb8e-736e-4bf0-a0e5-34826bd6bc70 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:57.187670 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d99fbb8e-736e-4bf0-a0e5-34826bd6bc70 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:57.188122 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d99fbb8e-736e-4bf0-a0e5-34826bd6bc70 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:57.188549 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d99fbb8e-736e-4bf0-a0e5-34826bd6bc70 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:57.322945 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d99fbb8e-736e-4bf0-a0e5-34826bd6bc70 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802764869c14db0b94ed8def1b12606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2381d626c4ac4228b893873ccaf0f23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:57.333572 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d99fbb8e-736e-4bf0-a0e5-34826bd6bc70 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 200 len: 1469 microversion: 2.1 time: 0.158594 Aug 18 14:35:57.334151 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 473/957] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:57 2022] GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:35:58.356431 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-42474806-f2f7-447d-89f3-e3c1f824f9cd tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:58.357139 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-42474806-f2f7-447d-89f3-e3c1f824f9cd tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:58.364438 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42474806-f2f7-447d-89f3-e3c1f824f9cd tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:58.365023 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42474806-f2f7-447d-89f3-e3c1f824f9cd tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:58.365460 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42474806-f2f7-447d-89f3-e3c1f824f9cd tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:58.366153 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42474806-f2f7-447d-89f3-e3c1f824f9cd tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:58.366610 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42474806-f2f7-447d-89f3-e3c1f824f9cd tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:58.367037 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42474806-f2f7-447d-89f3-e3c1f824f9cd tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:58.539343 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-42474806-f2f7-447d-89f3-e3c1f824f9cd tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd802764869c14db0b94ed8def1b12606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2381d626c4ac4228b893873ccaf0f23a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:35:58.547044 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-42474806-f2f7-447d-89f3-e3c1f824f9cd tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 200 len: 1469 microversion: 2.1 time: 0.194813 Aug 18 14:35:58.547638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 485/958] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:58 2022] GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 1469 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:35:58.951554 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-5b69d25c-c521-4036-897f-c6b759593a28 req-ef52fe9c-ce52-489d-a3de-34c60a66ad3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a656c71-8840-4f45-b0ff-6f54a618f771", "name": "network-vif-deleted", "tag": "7378a5b9-aba6-4eb2-b563-cf7e03880c2e"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:35:58.966841 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5b69d25c-c521-4036-897f-c6b759593a28 req-ef52fe9c-ce52-489d-a3de-34c60a66ad3f service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:58.967333 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5b69d25c-c521-4036-897f-c6b759593a28 req-ef52fe9c-ce52-489d-a3de-34c60a66ad3f service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:58.968056 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5b69d25c-c521-4036-897f-c6b759593a28 req-ef52fe9c-ce52-489d-a3de-34c60a66ad3f service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:58.981484 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-5b69d25c-c521-4036-897f-c6b759593a28 req-ef52fe9c-ce52-489d-a3de-34c60a66ad3f service nova] Creating event network-vif-deleted:7378a5b9-aba6-4eb2-b563-cf7e03880c2e for instance 0a656c71-8840-4f45-b0ff-6f54a618f771 on hv-cinder-85220 Aug 18 14:35:58.986737 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-5b69d25c-c521-4036-897f-c6b759593a28 req-ef52fe9c-ce52-489d-a3de-34c60a66ad3f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042712 Aug 18 14:35:58.987346 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 474/959] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:35:59.569256 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3f8d22e5-2d8b-44fe-9887-93a51b703e94 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:35:59.569874 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3f8d22e5-2d8b-44fe-9887-93a51b703e94 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] [instance: 0a656c71-8840-4f45-b0ff-6f54a618f771] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:35:59.576696 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f8d22e5-2d8b-44fe-9887-93a51b703e94 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:59.577179 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f8d22e5-2d8b-44fe-9887-93a51b703e94 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:59.577609 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f8d22e5-2d8b-44fe-9887-93a51b703e94 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:59.578289 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f8d22e5-2d8b-44fe-9887-93a51b703e94 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:35:59.578744 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f8d22e5-2d8b-44fe-9887-93a51b703e94 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:35:59.579164 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f8d22e5-2d8b-44fe-9887-93a51b703e94 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:35:59.592832 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-3f8d22e5-2d8b-44fe-9887-93a51b703e94 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] HTTP exception thrown: Instance 0a656c71-8840-4f45-b0ff-6f54a618f771 could not be found. Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3f8d22e5-2d8b-44fe-9887-93a51b703e94 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Request method failure captured: Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 HTTP/1.1 Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_k5Avv_7rs1maCcYnU3pOGzByjmv1Hf5VtMBM7E_u18p3Lsk5wsVFe7wAEu6w334WKfFCo7coJavwUPZtWbzxiti2mGC6vNFNUjgbc0q3YIy9fF430pfNKAgBzFiKvA36h70m9TCn7Bn8tX7_IlIEuKCcXidBDpTkYwpG_hn7EWJl9o Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 2381d626c4ac4228b893873ccaf0f23a Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesNegativeTest-336265083 Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:35:59.594440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:35:59.596190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2381d626c4ac4228b893873ccaf0f23a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2381d626c4ac4228b893873ccaf0f23a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2381d626c4ac4228b893873ccaf0f23a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2381d626c4ac4228b893873ccaf0f23a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:35:59.596190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesNegativeTest-336265083 Aug 18 14:35:59.596190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 2381d626c4ac4228b893873ccaf0f23a Aug 18 14:35:59.596190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesNegativeTest-336265083 Aug 18 14:35:59.596190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesNegativeTest-336265083-project Aug 18 14:35:59.596190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:35:59.596190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:35:59.596190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: d802764869c14db0b94ed8def1b12606 Aug 18 14:35:59.596190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesNegativeTest-336265083-project Aug 18 14:35:59.596190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:35:59.596190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance 0a656c71-8840-4f45-b0ff-6f54a618f771 could not be found. Aug 18 14:35:59.596190 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '0a656c71-8840-4f45-b0ff-6f54a618f771'} Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a656c71-8840-4f45-b0ff-6f54a618f771 could not be found. Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:35:59.597349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a656c71-8840-4f45-b0ff-6f54a618f771 could not be found. Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a656c71-8840-4f45-b0ff-6f54a618f771 could not be found. Aug 18 14:35:59.599694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:35:59.601238 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3f8d22e5-2d8b-44fe-9887-93a51b703e94 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] Returning 404 to user: Instance 0a656c71-8840-4f45-b0ff-6f54a618f771 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:35:59.601238 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3f8d22e5-2d8b-44fe-9887-93a51b703e94 tempest-VolumesNegativeTest-336265083 tempest-VolumesNegativeTest-336265083-project] 10.222.0.39 "GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771" status: 404 len: 111 microversion: 2.1 time: 0.030767 Aug 18 14:35:59.601238 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 486/960] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:35:59 2022] GET /compute/v2.1/servers/0a656c71-8840-4f45-b0ff-6f54a618f771 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:36:13.707217 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:36:13.709352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=38 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:36:13.911861 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-41cd19d3-a710-4511-9a25-413d51962a83 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Action: 'create', calling method: .version_select at 0x7fb621e978b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1140606863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8MWgSWKyWvQBMAX7l+JXImDPfEykn5zxyr8HwGshRX3Uo9zxS0tTG+ynYcAACJJbVFQhfMKLq9k+C1HMVUQlhiwidLKo1+Xp9fS1klqJU8b0HWwOT4B/dEfqqlcxKEbg=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:36:13.927846 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-41cd19d3-a710-4511-9a25-413d51962a83 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Getting quotas for project 03d2d48f0a554e579327d99976c599ea. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:36:13.931893 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-41cd19d3-a710-4511-9a25-413d51962a83 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Getting quotas for user 21e6d2a2bba74fe1bea18a25f73d83d7 and project 03d2d48f0a554e579327d99976c599ea. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:36:13.945338 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR oslo.messaging._drivers.impl_rabbit [None req-41cd19d3-a710-4511-9a25-413d51962a83 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [3f52b8d3-813c-4f0d-bdae-42df333ee2a2] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 14:36:14.952766 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [None req-41cd19d3-a710-4511-9a25-413d51962a83 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [3f52b8d3-813c-4f0d-bdae-42df333ee2a2] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 46720. Aug 18 14:36:14.968223 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-41cd19d3-a710-4511-9a25-413d51962a83 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.262596 Aug 18 14:36:14.968759 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 475/961] 10.222.0.39 () {60 vars in 1159 bytes} [Thu Aug 18 14:36:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:36:30.182425 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1000686717", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1140606863", "security_groups": [{"name": "tempest-secgroup-smoke-42812703"}], "networks": [{"uuid": "4667a44f-7a4c-4172-935e-3f9cbf7ca122"}], "block_device_mapping_v2": [{"uuid": "858a720a-408e-4d3b-9274-c57f2b732f41", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:36:30.192548 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:36:30.193353 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:36:30.259708 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:36:30.260462 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:36:30.264927 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-29ab67c1-9513-4355-842c-36e57e0ec728 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:30.265552 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-29ab67c1-9513-4355-842c-36e57e0ec728 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:30.273894 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29ab67c1-9513-4355-842c-36e57e0ec728 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:30.274406 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29ab67c1-9513-4355-842c-36e57e0ec728 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:30.274829 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29ab67c1-9513-4355-842c-36e57e0ec728 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:30.275559 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29ab67c1-9513-4355-842c-36e57e0ec728 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:30.276021 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29ab67c1-9513-4355-842c-36e57e0ec728 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:30.276452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29ab67c1-9513-4355-842c-36e57e0ec728 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:30.303059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-29ab67c1-9513-4355-842c-36e57e0ec728 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:36:30.307828 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] validate_networks() for [('4667a44f-7a4c-4172-935e-3f9cbf7ca122', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:36:30.382679 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-29ab67c1-9513-4355-842c-36e57e0ec728 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "DELETE /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 204 len: 0 microversion: 2.1 time: 0.123990 Aug 18 14:36:30.383014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 476/962] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:36:30 2022] DELETE /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 14:36:30.391767 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-144d05be-104d-4eeb-af99-644ad11eac71 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:30.392475 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-144d05be-104d-4eeb-af99-644ad11eac71 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:30.398295 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-144d05be-104d-4eeb-af99-644ad11eac71 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:30.398780 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-144d05be-104d-4eeb-af99-644ad11eac71 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:30.399214 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-144d05be-104d-4eeb-af99-644ad11eac71 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:30.399934 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-144d05be-104d-4eeb-af99-644ad11eac71 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:30.400389 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-144d05be-104d-4eeb-af99-644ad11eac71 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:30.400816 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-144d05be-104d-4eeb-af99-644ad11eac71 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:30.541355 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-144d05be-104d-4eeb-af99-644ad11eac71 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:30.549088 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-144d05be-104d-4eeb-af99-644ad11eac71 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1577 microversion: 2.1 time: 0.161520 Aug 18 14:36:30.549658 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 477/963] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:30 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:36:30.788616 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:36:30.789050 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:36:30.789530 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:36:30.789950 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:36:30.790367 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:36:30.799150 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:30.799661 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:30.800100 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:30.800829 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:30.801289 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:30.802250 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:30.820856 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Getting quotas for project 03d2d48f0a554e579327d99976c599ea. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:36:30.824846 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Getting quotas for user 21e6d2a2bba74fe1bea18a25f73d83d7 and project 03d2d48f0a554e579327d99976c599ea. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:36:30.880918 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:36:30.883063 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='858a720a-408e-4d3b-9274-c57f2b732f41',volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:36:31.011711 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d1f84f90-6f52-465d-9924-d101e0f6957d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.832991 Aug 18 14:36:31.012351 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 487/964] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:36:30 2022] POST /compute/v2.1/servers => generated 404 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:36:31.023304 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-76d756ee-f00c-4c64-992c-e1ce86736f46 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:31.023950 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-76d756ee-f00c-4c64-992c-e1ce86736f46 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:31.078840 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-76d756ee-f00c-4c64-992c-e1ce86736f46 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:31.086196 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-76d756ee-f00c-4c64-992c-e1ce86736f46 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1089 microversion: 2.1 time: 0.066720 Aug 18 14:36:31.099761 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 478/965] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:31 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:31.571582 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-84711496-b63b-4f8e-8cd5-c5a6a23cd63e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:31.572254 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-84711496-b63b-4f8e-8cd5-c5a6a23cd63e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:31.578353 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84711496-b63b-4f8e-8cd5-c5a6a23cd63e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:31.578920 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84711496-b63b-4f8e-8cd5-c5a6a23cd63e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:31.579262 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84711496-b63b-4f8e-8cd5-c5a6a23cd63e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:31.579981 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84711496-b63b-4f8e-8cd5-c5a6a23cd63e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:31.580569 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84711496-b63b-4f8e-8cd5-c5a6a23cd63e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:31.580996 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84711496-b63b-4f8e-8cd5-c5a6a23cd63e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:31.715081 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-84711496-b63b-4f8e-8cd5-c5a6a23cd63e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:31.722803 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-84711496-b63b-4f8e-8cd5-c5a6a23cd63e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1577 microversion: 2.1 time: 0.156130 Aug 18 14:36:31.723384 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 488/966] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:31 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:32.108258 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7ecf762c-95b7-4b14-974a-7cd242fb2a4d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:32.108877 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7ecf762c-95b7-4b14-974a-7cd242fb2a4d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:32.118454 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ecf762c-95b7-4b14-974a-7cd242fb2a4d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:32.119304 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ecf762c-95b7-4b14-974a-7cd242fb2a4d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:32.120144 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ecf762c-95b7-4b14-974a-7cd242fb2a4d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:32.121121 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ecf762c-95b7-4b14-974a-7cd242fb2a4d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:32.121590 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ecf762c-95b7-4b14-974a-7cd242fb2a4d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:32.122308 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ecf762c-95b7-4b14-974a-7cd242fb2a4d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:32.206450 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7ecf762c-95b7-4b14-974a-7cd242fb2a4d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:32.217688 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7ecf762c-95b7-4b14-974a-7cd242fb2a4d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1195 microversion: 2.1 time: 0.113317 Aug 18 14:36:32.218771 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 479/967] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:32 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1195 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:32.743722 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3c4e59a0-5b53-4bbb-b8e5-c49ca4851a9c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:32.744348 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3c4e59a0-5b53-4bbb-b8e5-c49ca4851a9c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:32.751595 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c4e59a0-5b53-4bbb-b8e5-c49ca4851a9c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:32.752373 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c4e59a0-5b53-4bbb-b8e5-c49ca4851a9c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:32.752983 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c4e59a0-5b53-4bbb-b8e5-c49ca4851a9c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:32.753870 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c4e59a0-5b53-4bbb-b8e5-c49ca4851a9c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:32.754334 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c4e59a0-5b53-4bbb-b8e5-c49ca4851a9c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:32.755309 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c4e59a0-5b53-4bbb-b8e5-c49ca4851a9c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:33.058478 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3c4e59a0-5b53-4bbb-b8e5-c49ca4851a9c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:33.066938 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3c4e59a0-5b53-4bbb-b8e5-c49ca4851a9c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1577 microversion: 2.1 time: 0.327220 Aug 18 14:36:33.067635 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 489/968] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:32 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1577 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:33.241724 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-576e9a69-df56-4c51-a1b4-30be8d04d762 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:33.242346 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-576e9a69-df56-4c51-a1b4-30be8d04d762 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:33.249122 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-576e9a69-df56-4c51-a1b4-30be8d04d762 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:33.249624 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-576e9a69-df56-4c51-a1b4-30be8d04d762 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:33.250059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-576e9a69-df56-4c51-a1b4-30be8d04d762 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:33.250947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-576e9a69-df56-4c51-a1b4-30be8d04d762 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:33.251443 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-576e9a69-df56-4c51-a1b4-30be8d04d762 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:33.251898 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-576e9a69-df56-4c51-a1b4-30be8d04d762 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:33.316545 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-576e9a69-df56-4c51-a1b4-30be8d04d762 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:33.325048 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-576e9a69-df56-4c51-a1b4-30be8d04d762 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1193 microversion: 2.1 time: 0.088001 Aug 18 14:36:33.326061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 480/969] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:33 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:36:33.745976 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-e8abd389-71f3-4611-aa24-5e5e4097ebaf req-d6618ab5-7866-4e9e-910d-2ac7e135401c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16f49170-7caf-4e52-8328-d67867701796", "name": "network-vif-deleted", "tag": "debb6e48-b9f6-494e-ae2b-d352ff3d6c73"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:36:33.765218 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-e8abd389-71f3-4611-aa24-5e5e4097ebaf req-d6618ab5-7866-4e9e-910d-2ac7e135401c service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:33.766011 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-e8abd389-71f3-4611-aa24-5e5e4097ebaf req-d6618ab5-7866-4e9e-910d-2ac7e135401c service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:33.767941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-e8abd389-71f3-4611-aa24-5e5e4097ebaf req-d6618ab5-7866-4e9e-910d-2ac7e135401c service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:33.788543 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-e8abd389-71f3-4611-aa24-5e5e4097ebaf req-d6618ab5-7866-4e9e-910d-2ac7e135401c service nova] Creating event network-vif-deleted:debb6e48-b9f6-494e-ae2b-d352ff3d6c73 for instance 16f49170-7caf-4e52-8328-d67867701796 on hv-cinder-85220 Aug 18 14:36:33.796035 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-e8abd389-71f3-4611-aa24-5e5e4097ebaf req-d6618ab5-7866-4e9e-910d-2ac7e135401c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053083 Aug 18 14:36:33.797234 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 490/970] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:36:34.088774 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:34.089403 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:34.096951 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:34.097806 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:34.099907 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:34.100879 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:34.101590 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:34.102091 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:34.136111 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:34.137049 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:34.137501 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:34.137959 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lazy-loading 'fault' on Instance uuid 16f49170-7caf-4e52-8328-d67867701796 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:36:34.182956 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:34.191546 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-92eb19a9-5194-4f87-a62a-e10e1ca8f06b tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 200 len: 1230 microversion: 2.1 time: 0.106877 Aug 18 14:36:34.192345 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 481/971] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:34 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:34.346698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d88c1432-4ac9-4a66-96de-f4ecf8e442fc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:34.347428 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d88c1432-4ac9-4a66-96de-f4ecf8e442fc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:34.358630 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d88c1432-4ac9-4a66-96de-f4ecf8e442fc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:34.358630 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d88c1432-4ac9-4a66-96de-f4ecf8e442fc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:34.359053 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d88c1432-4ac9-4a66-96de-f4ecf8e442fc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:34.359792 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d88c1432-4ac9-4a66-96de-f4ecf8e442fc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:34.360433 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d88c1432-4ac9-4a66-96de-f4ecf8e442fc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:34.361023 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d88c1432-4ac9-4a66-96de-f4ecf8e442fc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:34.632884 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d88c1432-4ac9-4a66-96de-f4ecf8e442fc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:34.641126 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d88c1432-4ac9-4a66-96de-f4ecf8e442fc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1259 microversion: 2.1 time: 0.298742 Aug 18 14:36:34.641700 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 491/972] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:34 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1259 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:35.213063 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f690238e-0c10-44cb-b801-bdf624199f3d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:35.213696 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f690238e-0c10-44cb-b801-bdf624199f3d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:35.220329 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f690238e-0c10-44cb-b801-bdf624199f3d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:35.220749 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f690238e-0c10-44cb-b801-bdf624199f3d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:35.221188 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f690238e-0c10-44cb-b801-bdf624199f3d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:35.221876 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f690238e-0c10-44cb-b801-bdf624199f3d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:35.222324 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f690238e-0c10-44cb-b801-bdf624199f3d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:35.222743 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f690238e-0c10-44cb-b801-bdf624199f3d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:35.236497 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-f690238e-0c10-44cb-b801-bdf624199f3d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] HTTP exception thrown: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f690238e-0c10-44cb-b801-bdf624199f3d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Request method failure captured: Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 HTTP/1.1 Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_k3QjMFB4Yq8KQTYkzSNN6uahNSzfzQvlBbXA_h-VdXt0nLslz12krAuVUynvHgr3_5OpLijn_LH4hN_kAQY5KGl2GbPUx1emP6CnJ55r2uFg5fLTFlSPVSVDOZNeyKqkhh6GGSaz4oROYv_rtmu5phJRbdLF7etf620QtmhW5XcIrY Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: e87465b1253547a49284b8be4673305d Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:36:35.238123 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:36:35.240352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e87465b1253547a49284b8be4673305d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e87465b1253547a49284b8be4673305d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e87465b1253547a49284b8be4673305d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e87465b1253547a49284b8be4673305d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:36:35.240352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:36:35.240352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: e87465b1253547a49284b8be4673305d Aug 18 14:36:35.240352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:36:35.240352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-TestVolumeBootPattern-1400655896-project Aug 18 14:36:35.240352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:36:35.240352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:36:35.240352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 3191363bf5794cfd91926141994e9d6b Aug 18 14:36:35.240352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-TestVolumeBootPattern-1400655896-project Aug 18 14:36:35.240352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:36:35.240352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:36:35.240352 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '16f49170-7caf-4e52-8328-d67867701796'} Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:36:35.241251 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:36:35.242867 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:36:35.244386 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f690238e-0c10-44cb-b801-bdf624199f3d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Returning 404 to user: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:36:35.244386 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f690238e-0c10-44cb-b801-bdf624199f3d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 404 len: 111 microversion: 2.1 time: 0.031408 Aug 18 14:36:35.244386 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 482/973] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:35 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:36:35.336744 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2007157994", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1701044862", "security_groups": [{"name": "tempest-secgroup-smoke-1339569545"}], "block_device_mapping_v2": [{"uuid": "7ba2d025-e061-44de-8e8e-e000cb440fea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "95ff3be2-bdc5-4aad-b19b-f4b034623f47"}]}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:36:35.456077 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] validate_networks() for [('95ff3be2-bdc5-4aad-b19b-f4b034623f47', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:36:35.660501 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5b8bd346-22b6-4909-b3a8-b099d96523de tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:35.661424 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5b8bd346-22b6-4909-b3a8-b099d96523de tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:35.667384 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b8bd346-22b6-4909-b3a8-b099d96523de tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:35.667882 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b8bd346-22b6-4909-b3a8-b099d96523de tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:35.668315 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b8bd346-22b6-4909-b3a8-b099d96523de tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:35.669119 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b8bd346-22b6-4909-b3a8-b099d96523de tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:35.669574 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b8bd346-22b6-4909-b3a8-b099d96523de tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:35.669997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b8bd346-22b6-4909-b3a8-b099d96523de tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:35.804444 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5b8bd346-22b6-4909-b3a8-b099d96523de tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:35.812567 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5b8bd346-22b6-4909-b3a8-b099d96523de tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1259 microversion: 2.1 time: 0.155834 Aug 18 14:36:35.823582 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 483/974] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:35 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:36:35.841306 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-1b529dc0-312f-4548-82fd-881330ea5df7 req-a3aa367d-91ec-4eb5-acd6-0a4bb711009b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa24417-8c8d-4180-9f39-d8267f508448", "tag": "8e2ef947-6068-4749-9d9a-60018117a9f9"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:36:35.841683 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:36:35.842111 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:36:35.842587 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:36:35.843002 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:36:35.843466 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:36:35.851287 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1b529dc0-312f-4548-82fd-881330ea5df7 req-a3aa367d-91ec-4eb5-acd6-0a4bb711009b service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:35.851790 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1b529dc0-312f-4548-82fd-881330ea5df7 req-a3aa367d-91ec-4eb5-acd6-0a4bb711009b service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:35.852221 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1b529dc0-312f-4548-82fd-881330ea5df7 req-a3aa367d-91ec-4eb5-acd6-0a4bb711009b service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:35.852788 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:35.853271 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:35.853706 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:35.854437 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:35.854893 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:35.855316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:35.862896 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-1b529dc0-312f-4548-82fd-881330ea5df7 req-a3aa367d-91ec-4eb5-acd6-0a4bb711009b service nova] Creating event network-changed:8e2ef947-6068-4749-9d9a-60018117a9f9 for instance 2aa24417-8c8d-4180-9f39-d8267f508448 on hv-cinder-85220 Aug 18 14:36:35.869158 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-1b529dc0-312f-4548-82fd-881330ea5df7 req-a3aa367d-91ec-4eb5-acd6-0a4bb711009b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031917 Aug 18 14:36:35.869750 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 484/975] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:36:35.872445 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Getting quotas for project e87465b1253547a49284b8be4673305d. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:36:35.876412 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Getting quotas for user 3191363bf5794cfd91926141994e9d6b and project e87465b1253547a49284b8be4673305d. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:36:35.934371 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:36:35.936558 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ba2d025-e061-44de-8e8e-e000cb440fea',volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:36:36.074613 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a442f024-062e-4169-b27f-4dfcde0ad0bd tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741860 Aug 18 14:36:36.081524 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 492/976] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:36:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 14:36:36.087482 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9657fd6b-dd5e-4172-916d-51383957bd75 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:36.088245 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9657fd6b-dd5e-4172-916d-51383957bd75 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:36.163298 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9657fd6b-dd5e-4172-916d-51383957bd75 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:36.170954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9657fd6b-dd5e-4172-916d-51383957bd75 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1095 microversion: 2.1 time: 0.087715 Aug 18 14:36:36.171585 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 485/977] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:36 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1095 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:36.835062 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-85b0e3b6-3e53-4154-92c5-e389278abc02 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:36.835708 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-85b0e3b6-3e53-4154-92c5-e389278abc02 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:36.842007 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85b0e3b6-3e53-4154-92c5-e389278abc02 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:36.842489 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85b0e3b6-3e53-4154-92c5-e389278abc02 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:36.842924 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85b0e3b6-3e53-4154-92c5-e389278abc02 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:36.843652 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85b0e3b6-3e53-4154-92c5-e389278abc02 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:36.844107 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85b0e3b6-3e53-4154-92c5-e389278abc02 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:36.844538 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85b0e3b6-3e53-4154-92c5-e389278abc02 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:37.046350 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-85b0e3b6-3e53-4154-92c5-e389278abc02 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:37.057388 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-85b0e3b6-3e53-4154-92c5-e389278abc02 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1259 microversion: 2.1 time: 0.226956 Aug 18 14:36:37.060036 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 493/978] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:36 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:37.192736 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-74b94a61-c417-4973-a776-86dbb13ff6a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:37.193547 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-74b94a61-c417-4973-a776-86dbb13ff6a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:37.200998 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74b94a61-c417-4973-a776-86dbb13ff6a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:37.201457 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74b94a61-c417-4973-a776-86dbb13ff6a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:37.202113 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74b94a61-c417-4973-a776-86dbb13ff6a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:37.202813 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74b94a61-c417-4973-a776-86dbb13ff6a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:37.203476 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74b94a61-c417-4973-a776-86dbb13ff6a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:37.203910 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74b94a61-c417-4973-a776-86dbb13ff6a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:37.269423 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-74b94a61-c417-4973-a776-86dbb13ff6a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:37.278114 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-74b94a61-c417-4973-a776-86dbb13ff6a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1211 microversion: 2.1 time: 0.089703 Aug 18 14:36:37.278696 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 486/979] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:37 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:38.079203 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-49b3ed14-ae8b-454c-a9d5-0bafcdc4288c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:38.080058 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-49b3ed14-ae8b-454c-a9d5-0bafcdc4288c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:38.087422 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49b3ed14-ae8b-454c-a9d5-0bafcdc4288c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:38.087914 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49b3ed14-ae8b-454c-a9d5-0bafcdc4288c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:38.088350 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49b3ed14-ae8b-454c-a9d5-0bafcdc4288c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:38.089056 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49b3ed14-ae8b-454c-a9d5-0bafcdc4288c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:38.089512 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49b3ed14-ae8b-454c-a9d5-0bafcdc4288c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:38.089939 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49b3ed14-ae8b-454c-a9d5-0bafcdc4288c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:38.300315 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6e0a9ce0-4426-4b97-ba58-76f4223d3e95 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:38.300943 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6e0a9ce0-4426-4b97-ba58-76f4223d3e95 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:38.307790 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e0a9ce0-4426-4b97-ba58-76f4223d3e95 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:38.308286 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e0a9ce0-4426-4b97-ba58-76f4223d3e95 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:38.308724 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e0a9ce0-4426-4b97-ba58-76f4223d3e95 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:38.309429 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e0a9ce0-4426-4b97-ba58-76f4223d3e95 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:38.309883 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e0a9ce0-4426-4b97-ba58-76f4223d3e95 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:38.310330 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e0a9ce0-4426-4b97-ba58-76f4223d3e95 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:38.320487 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-49b3ed14-ae8b-454c-a9d5-0bafcdc4288c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:38.328948 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-49b3ed14-ae8b-454c-a9d5-0bafcdc4288c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1259 microversion: 2.1 time: 0.253683 Aug 18 14:36:38.330248 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 494/980] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:38 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1259 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:38.421211 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-337264d2-661d-409c-a6d0-6cb87d4417f8 req-77ae2b87-a557-46f5-beef-9d90c741294a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ab7dd8d-369d-4bb1-b967-9154b171fb28", "tag": "8bad3cf2-cd2d-486e-b0f8-017d64cb688d"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:36:38.447021 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-337264d2-661d-409c-a6d0-6cb87d4417f8 req-77ae2b87-a557-46f5-beef-9d90c741294a service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:38.448040 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-337264d2-661d-409c-a6d0-6cb87d4417f8 req-77ae2b87-a557-46f5-beef-9d90c741294a service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:38.449218 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-337264d2-661d-409c-a6d0-6cb87d4417f8 req-77ae2b87-a557-46f5-beef-9d90c741294a service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:38.452059 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6e0a9ce0-4426-4b97-ba58-76f4223d3e95 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:38.460925 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6e0a9ce0-4426-4b97-ba58-76f4223d3e95 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1267 microversion: 2.1 time: 0.164501 Aug 18 14:36:38.462361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 487/981] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:38 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:36:38.468228 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-337264d2-661d-409c-a6d0-6cb87d4417f8 req-77ae2b87-a557-46f5-beef-9d90c741294a service nova] Creating event network-changed:8bad3cf2-cd2d-486e-b0f8-017d64cb688d for instance 3ab7dd8d-369d-4bb1-b967-9154b171fb28 on hv-cinder-85220 Aug 18 14:36:38.478522 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-337264d2-661d-409c-a6d0-6cb87d4417f8 req-77ae2b87-a557-46f5-beef-9d90c741294a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060930 Aug 18 14:36:38.479067 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 495/982] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:36:39.351927 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7cd872fb-e59d-485e-af2b-abc722261105 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:39.352446 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7cd872fb-e59d-485e-af2b-abc722261105 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:39.359299 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cd872fb-e59d-485e-af2b-abc722261105 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:39.359901 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cd872fb-e59d-485e-af2b-abc722261105 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:39.360412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cd872fb-e59d-485e-af2b-abc722261105 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:39.361129 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cd872fb-e59d-485e-af2b-abc722261105 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:39.361613 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cd872fb-e59d-485e-af2b-abc722261105 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:39.362044 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cd872fb-e59d-485e-af2b-abc722261105 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:39.484995 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-716a4da4-23f7-44f6-a307-9ac5f0885ba6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:39.486409 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-716a4da4-23f7-44f6-a307-9ac5f0885ba6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:39.496092 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-716a4da4-23f7-44f6-a307-9ac5f0885ba6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:39.496590 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-716a4da4-23f7-44f6-a307-9ac5f0885ba6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:39.497090 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-716a4da4-23f7-44f6-a307-9ac5f0885ba6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:39.497831 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-716a4da4-23f7-44f6-a307-9ac5f0885ba6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:39.498078 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7cd872fb-e59d-485e-af2b-abc722261105 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:39.498268 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-716a4da4-23f7-44f6-a307-9ac5f0885ba6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:39.498704 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-716a4da4-23f7-44f6-a307-9ac5f0885ba6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:39.507656 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7cd872fb-e59d-485e-af2b-abc722261105 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1259 microversion: 2.1 time: 0.160161 Aug 18 14:36:39.508578 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 488/983] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:39 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:39.652122 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-716a4da4-23f7-44f6-a307-9ac5f0885ba6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:39.659810 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-716a4da4-23f7-44f6-a307-9ac5f0885ba6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1267 microversion: 2.1 time: 0.179640 Aug 18 14:36:39.660375 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 496/984] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:39 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:40.528597 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c0d68f3c-3719-464b-92a7-42d6ad6ae56f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:40.529136 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c0d68f3c-3719-464b-92a7-42d6ad6ae56f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:40.536407 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0d68f3c-3719-464b-92a7-42d6ad6ae56f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:40.536978 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0d68f3c-3719-464b-92a7-42d6ad6ae56f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:40.537413 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0d68f3c-3719-464b-92a7-42d6ad6ae56f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:40.538119 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0d68f3c-3719-464b-92a7-42d6ad6ae56f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:40.538565 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0d68f3c-3719-464b-92a7-42d6ad6ae56f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:40.538997 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0d68f3c-3719-464b-92a7-42d6ad6ae56f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:40.669307 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c0d68f3c-3719-464b-92a7-42d6ad6ae56f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:40.677952 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c0d68f3c-3719-464b-92a7-42d6ad6ae56f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1259 microversion: 2.1 time: 0.153252 Aug 18 14:36:40.678515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 489/985] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:40 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:40.680692 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4dc089b1-8400-4e2b-9198-8d4a2a375096 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:40.681351 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4dc089b1-8400-4e2b-9198-8d4a2a375096 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:40.687790 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4dc089b1-8400-4e2b-9198-8d4a2a375096 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:40.688277 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4dc089b1-8400-4e2b-9198-8d4a2a375096 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:40.688718 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4dc089b1-8400-4e2b-9198-8d4a2a375096 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:40.689411 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4dc089b1-8400-4e2b-9198-8d4a2a375096 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:40.689868 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4dc089b1-8400-4e2b-9198-8d4a2a375096 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:40.690298 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4dc089b1-8400-4e2b-9198-8d4a2a375096 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:40.823354 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4dc089b1-8400-4e2b-9198-8d4a2a375096 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:40.831161 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4dc089b1-8400-4e2b-9198-8d4a2a375096 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1267 microversion: 2.1 time: 0.154322 Aug 18 14:36:40.831785 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 497/986] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:40 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:36:41.698405 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-69935a78-9232-47a4-b59f-1c9ce8a23f39 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:41.699024 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-69935a78-9232-47a4-b59f-1c9ce8a23f39 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:41.705459 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69935a78-9232-47a4-b59f-1c9ce8a23f39 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:41.705954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69935a78-9232-47a4-b59f-1c9ce8a23f39 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:41.706391 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69935a78-9232-47a4-b59f-1c9ce8a23f39 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:41.707082 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69935a78-9232-47a4-b59f-1c9ce8a23f39 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:41.707598 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69935a78-9232-47a4-b59f-1c9ce8a23f39 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:41.708015 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69935a78-9232-47a4-b59f-1c9ce8a23f39 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:41.838962 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-69935a78-9232-47a4-b59f-1c9ce8a23f39 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:41.846683 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-69935a78-9232-47a4-b59f-1c9ce8a23f39 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1259 microversion: 2.1 time: 0.152188 Aug 18 14:36:41.847341 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 490/987] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:41 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:41.852740 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1d903e4e-9ec8-40c2-b7d1-e279e0639333 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:41.853366 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1d903e4e-9ec8-40c2-b7d1-e279e0639333 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:41.859528 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d903e4e-9ec8-40c2-b7d1-e279e0639333 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:41.860022 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d903e4e-9ec8-40c2-b7d1-e279e0639333 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:41.860460 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d903e4e-9ec8-40c2-b7d1-e279e0639333 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:41.861156 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d903e4e-9ec8-40c2-b7d1-e279e0639333 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:41.861614 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d903e4e-9ec8-40c2-b7d1-e279e0639333 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:41.862044 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d903e4e-9ec8-40c2-b7d1-e279e0639333 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:41.993998 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1d903e4e-9ec8-40c2-b7d1-e279e0639333 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:42.001639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1d903e4e-9ec8-40c2-b7d1-e279e0639333 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1267 microversion: 2.1 time: 0.153389 Aug 18 14:36:42.002192 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 498/988] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:41 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:36:42.869020 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-949e8968-2abb-4e74-9c5f-6c5b9f431937 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:42.869660 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-949e8968-2abb-4e74-9c5f-6c5b9f431937 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:42.876117 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-949e8968-2abb-4e74-9c5f-6c5b9f431937 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:42.876603 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-949e8968-2abb-4e74-9c5f-6c5b9f431937 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:42.877046 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-949e8968-2abb-4e74-9c5f-6c5b9f431937 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:42.877739 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-949e8968-2abb-4e74-9c5f-6c5b9f431937 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:42.878205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-949e8968-2abb-4e74-9c5f-6c5b9f431937 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:42.878633 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-949e8968-2abb-4e74-9c5f-6c5b9f431937 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:43.016853 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-949e8968-2abb-4e74-9c5f-6c5b9f431937 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:43.022533 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3a15eaf5-983f-4014-8ac6-894344d6bee5 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:43.023151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3a15eaf5-983f-4014-8ac6-894344d6bee5 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:43.027105 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-949e8968-2abb-4e74-9c5f-6c5b9f431937 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1259 microversion: 2.1 time: 0.162095 Aug 18 14:36:43.027714 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 491/989] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:42 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:43.029415 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a15eaf5-983f-4014-8ac6-894344d6bee5 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:43.029895 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a15eaf5-983f-4014-8ac6-894344d6bee5 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:43.030328 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a15eaf5-983f-4014-8ac6-894344d6bee5 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:43.031017 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a15eaf5-983f-4014-8ac6-894344d6bee5 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:43.031500 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a15eaf5-983f-4014-8ac6-894344d6bee5 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:43.031926 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a15eaf5-983f-4014-8ac6-894344d6bee5 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:43.166893 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3a15eaf5-983f-4014-8ac6-894344d6bee5 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:43.174613 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3a15eaf5-983f-4014-8ac6-894344d6bee5 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1267 microversion: 2.1 time: 0.156557 Aug 18 14:36:43.175177 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 499/990] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:43 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:36:44.048172 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-445216ad-cd20-4b20-801d-d30be65e8afd tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:44.048788 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-445216ad-cd20-4b20-801d-d30be65e8afd tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:44.056207 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-445216ad-cd20-4b20-801d-d30be65e8afd tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:44.056691 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-445216ad-cd20-4b20-801d-d30be65e8afd tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:44.057124 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-445216ad-cd20-4b20-801d-d30be65e8afd tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:44.057819 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-445216ad-cd20-4b20-801d-d30be65e8afd tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:44.058303 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-445216ad-cd20-4b20-801d-d30be65e8afd tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:44.058724 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-445216ad-cd20-4b20-801d-d30be65e8afd tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:44.192677 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-445216ad-cd20-4b20-801d-d30be65e8afd tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:44.197400 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d3bfdfc8-0cb0-41b1-8745-d1c62937d238 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:44.198098 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d3bfdfc8-0cb0-41b1-8745-d1c62937d238 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:44.201607 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-445216ad-cd20-4b20-801d-d30be65e8afd tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1259 microversion: 2.1 time: 0.157205 Aug 18 14:36:44.202180 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 492/991] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:44 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:44.204222 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3bfdfc8-0cb0-41b1-8745-d1c62937d238 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:44.204703 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3bfdfc8-0cb0-41b1-8745-d1c62937d238 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:44.205133 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3bfdfc8-0cb0-41b1-8745-d1c62937d238 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:44.205817 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3bfdfc8-0cb0-41b1-8745-d1c62937d238 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:44.206265 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3bfdfc8-0cb0-41b1-8745-d1c62937d238 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:44.206683 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3bfdfc8-0cb0-41b1-8745-d1c62937d238 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:44.335872 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d3bfdfc8-0cb0-41b1-8745-d1c62937d238 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:44.343769 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d3bfdfc8-0cb0-41b1-8745-d1c62937d238 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1267 microversion: 2.1 time: 0.151409 Aug 18 14:36:44.344333 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 500/992] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:44 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:36:45.222358 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-28ef4c96-e3c5-4981-b1ff-cd5e032d562e tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:45.223137 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-28ef4c96-e3c5-4981-b1ff-cd5e032d562e tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:45.229839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28ef4c96-e3c5-4981-b1ff-cd5e032d562e tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:45.230328 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28ef4c96-e3c5-4981-b1ff-cd5e032d562e tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:45.230766 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28ef4c96-e3c5-4981-b1ff-cd5e032d562e tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:45.231489 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28ef4c96-e3c5-4981-b1ff-cd5e032d562e tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:45.231951 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28ef4c96-e3c5-4981-b1ff-cd5e032d562e tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:45.232381 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28ef4c96-e3c5-4981-b1ff-cd5e032d562e tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:45.364457 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a46b7f9c-5383-41d9-b0c5-7cc16d6130fc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:45.365080 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a46b7f9c-5383-41d9-b0c5-7cc16d6130fc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:45.366175 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-28ef4c96-e3c5-4981-b1ff-cd5e032d562e tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:45.369728 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:36:45.371664 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a46b7f9c-5383-41d9-b0c5-7cc16d6130fc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:45.372148 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a46b7f9c-5383-41d9-b0c5-7cc16d6130fc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:45.372767 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a46b7f9c-5383-41d9-b0c5-7cc16d6130fc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:45.373462 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a46b7f9c-5383-41d9-b0c5-7cc16d6130fc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:45.373918 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a46b7f9c-5383-41d9-b0c5-7cc16d6130fc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:45.374344 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a46b7f9c-5383-41d9-b0c5-7cc16d6130fc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:45.374947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-28ef4c96-e3c5-4981-b1ff-cd5e032d562e tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1259 microversion: 2.1 time: 0.156438 Aug 18 14:36:45.375834 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 493/993] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:45 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:45.505763 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a46b7f9c-5383-41d9-b0c5-7cc16d6130fc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:45.514297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a46b7f9c-5383-41d9-b0c5-7cc16d6130fc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1267 microversion: 2.1 time: 0.153890 Aug 18 14:36:45.514860 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 501/994] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:45 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:36:45.700319 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-9b1c716e-56b5-43d0-9208-939abce5a7c8 req-bb4ca358-b964-4f25-8ff6-be91e869f02b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa24417-8c8d-4180-9f39-d8267f508448", "name": "network-vif-plugged", "status": "completed", "tag": "8e2ef947-6068-4749-9d9a-60018117a9f9"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:36:45.710274 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-9b1c716e-56b5-43d0-9208-939abce5a7c8 req-bb4ca358-b964-4f25-8ff6-be91e869f02b service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:45.710733 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-9b1c716e-56b5-43d0-9208-939abce5a7c8 req-bb4ca358-b964-4f25-8ff6-be91e869f02b service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:45.711193 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-9b1c716e-56b5-43d0-9208-939abce5a7c8 req-bb4ca358-b964-4f25-8ff6-be91e869f02b service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:45.726003 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-9b1c716e-56b5-43d0-9208-939abce5a7c8 req-bb4ca358-b964-4f25-8ff6-be91e869f02b service nova] Creating event network-vif-plugged:8e2ef947-6068-4749-9d9a-60018117a9f9 for instance 2aa24417-8c8d-4180-9f39-d8267f508448 on hv-cinder-85220 Aug 18 14:36:45.730962 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-9b1c716e-56b5-43d0-9208-939abce5a7c8 req-bb4ca358-b964-4f25-8ff6-be91e869f02b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035054 Aug 18 14:36:45.731592 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 494/995] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:36:46.396631 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-856fbfc8-aa96-4827-8392-c82fda861252 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:46.397257 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-856fbfc8-aa96-4827-8392-c82fda861252 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:46.399177 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=4 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:36:46.399876 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=12 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:36:46.406302 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-856fbfc8-aa96-4827-8392-c82fda861252 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:46.406781 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-856fbfc8-aa96-4827-8392-c82fda861252 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:46.407213 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-856fbfc8-aa96-4827-8392-c82fda861252 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:46.407932 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-856fbfc8-aa96-4827-8392-c82fda861252 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:46.408384 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-856fbfc8-aa96-4827-8392-c82fda861252 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:46.408807 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-856fbfc8-aa96-4827-8392-c82fda861252 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:46.533439 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:36:46.538740 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-856fbfc8-aa96-4827-8392-c82fda861252 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:46.539291 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b9a49303-ed10-4bc6-80fb-80825ec35619 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:46.540112 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b9a49303-ed10-4bc6-80fb-80825ec35619 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:46.546455 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-856fbfc8-aa96-4827-8392-c82fda861252 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1259 microversion: 2.1 time: 0.154130 Aug 18 14:36:46.546799 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9a49303-ed10-4bc6-80fb-80825ec35619 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:46.547188 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 502/996] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:46 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:46.547431 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9a49303-ed10-4bc6-80fb-80825ec35619 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:46.547828 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9a49303-ed10-4bc6-80fb-80825ec35619 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:46.548528 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9a49303-ed10-4bc6-80fb-80825ec35619 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:46.548983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9a49303-ed10-4bc6-80fb-80825ec35619 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:46.549413 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9a49303-ed10-4bc6-80fb-80825ec35619 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:46.680461 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b9a49303-ed10-4bc6-80fb-80825ec35619 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:46.688191 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b9a49303-ed10-4bc6-80fb-80825ec35619 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1267 microversion: 2.1 time: 0.155705 Aug 18 14:36:46.688762 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 495/997] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:46 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:36:47.566173 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ad9bab4e-9f75-438a-9a3b-6f9f9558be12 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:47.567068 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ad9bab4e-9f75-438a-9a3b-6f9f9558be12 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:47.574997 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad9bab4e-9f75-438a-9a3b-6f9f9558be12 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:47.575532 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad9bab4e-9f75-438a-9a3b-6f9f9558be12 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:47.575967 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad9bab4e-9f75-438a-9a3b-6f9f9558be12 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:47.576712 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad9bab4e-9f75-438a-9a3b-6f9f9558be12 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:47.577176 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad9bab4e-9f75-438a-9a3b-6f9f9558be12 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:47.577608 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad9bab4e-9f75-438a-9a3b-6f9f9558be12 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:47.709156 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-21156278-272f-40c5-bdcb-4d8437c98c1d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:47.709805 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-21156278-272f-40c5-bdcb-4d8437c98c1d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:47.711216 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ad9bab4e-9f75-438a-9a3b-6f9f9558be12 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:47.716640 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21156278-272f-40c5-bdcb-4d8437c98c1d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:47.717131 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21156278-272f-40c5-bdcb-4d8437c98c1d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:47.717569 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21156278-272f-40c5-bdcb-4d8437c98c1d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:47.718266 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21156278-272f-40c5-bdcb-4d8437c98c1d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:47.718721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21156278-272f-40c5-bdcb-4d8437c98c1d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:47.719148 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21156278-272f-40c5-bdcb-4d8437c98c1d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:47.719349 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ad9bab4e-9f75-438a-9a3b-6f9f9558be12 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1443 microversion: 2.1 time: 0.157110 Aug 18 14:36:47.719942 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 503/998] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:47 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:47.740625 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2a670dd7-b3fe-4b2e-b6ae-890a53fdc4d3 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:47.741320 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2a670dd7-b3fe-4b2e-b6ae-890a53fdc4d3 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:47.747425 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a670dd7-b3fe-4b2e-b6ae-890a53fdc4d3 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:47.747933 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a670dd7-b3fe-4b2e-b6ae-890a53fdc4d3 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:47.748374 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a670dd7-b3fe-4b2e-b6ae-890a53fdc4d3 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:47.749124 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a670dd7-b3fe-4b2e-b6ae-890a53fdc4d3 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:47.749644 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a670dd7-b3fe-4b2e-b6ae-890a53fdc4d3 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:47.750073 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a670dd7-b3fe-4b2e-b6ae-890a53fdc4d3 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:47.856220 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-21156278-272f-40c5-bdcb-4d8437c98c1d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:47.864019 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-21156278-272f-40c5-bdcb-4d8437c98c1d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1267 microversion: 2.1 time: 0.158693 Aug 18 14:36:47.864836 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 496/999] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:47 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:36:47.869276 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-a568eec4-7ea0-4ddd-9691-691c40e4db1b req-38125aa0-bdf9-4c75-bda3-a0d04bbaac59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab7dd8d-369d-4bb1-b967-9154b171fb28", "name": "network-vif-plugged", "status": "completed", "tag": "8bad3cf2-cd2d-486e-b0f8-017d64cb688d"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:36:47.878204 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-a568eec4-7ea0-4ddd-9691-691c40e4db1b req-38125aa0-bdf9-4c75-bda3-a0d04bbaac59 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:47.878676 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-a568eec4-7ea0-4ddd-9691-691c40e4db1b req-38125aa0-bdf9-4c75-bda3-a0d04bbaac59 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:47.879104 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-a568eec4-7ea0-4ddd-9691-691c40e4db1b req-38125aa0-bdf9-4c75-bda3-a0d04bbaac59 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:47.884777 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2a670dd7-b3fe-4b2e-b6ae-890a53fdc4d3 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:47.890334 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-a568eec4-7ea0-4ddd-9691-691c40e4db1b req-38125aa0-bdf9-4c75-bda3-a0d04bbaac59 service nova] Creating event network-vif-plugged:8bad3cf2-cd2d-486e-b0f8-017d64cb688d for instance 3ab7dd8d-369d-4bb1-b967-9154b171fb28 on hv-cinder-85220 Aug 18 14:36:47.892707 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2a670dd7-b3fe-4b2e-b6ae-890a53fdc4d3 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1443 microversion: 2.1 time: 0.156788 Aug 18 14:36:47.894279 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 504/1000] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:47 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:36:47.896116 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-a568eec4-7ea0-4ddd-9691-691c40e4db1b req-38125aa0-bdf9-4c75-bda3-a0d04bbaac59 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029360 Aug 18 14:36:47.896784 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 497/1001] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:36:48.884996 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-286ba1fd-485e-416e-b948-2be80a01a146 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:48.885686 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-286ba1fd-485e-416e-b948-2be80a01a146 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:48.892313 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-286ba1fd-485e-416e-b948-2be80a01a146 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:48.892811 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-286ba1fd-485e-416e-b948-2be80a01a146 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:48.893250 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-286ba1fd-485e-416e-b948-2be80a01a146 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:48.893985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-286ba1fd-485e-416e-b948-2be80a01a146 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:48.894443 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-286ba1fd-485e-416e-b948-2be80a01a146 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:48.894923 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-286ba1fd-485e-416e-b948-2be80a01a146 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:49.042859 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-286ba1fd-485e-416e-b948-2be80a01a146 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:49.050956 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-286ba1fd-485e-416e-b948-2be80a01a146 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1267 microversion: 2.1 time: 0.169667 Aug 18 14:36:49.052310 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 505/1002] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:48 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:49.856814 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-47cf8ec1-1416-45c5-b222-6dfc69ed9403 req-9649479f-0db5-48b6-bd1c-58ed1f67d480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa24417-8c8d-4180-9f39-d8267f508448", "tag": "8e2ef947-6068-4749-9d9a-60018117a9f9"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:36:49.866823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-47cf8ec1-1416-45c5-b222-6dfc69ed9403 req-9649479f-0db5-48b6-bd1c-58ed1f67d480 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:49.867297 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-47cf8ec1-1416-45c5-b222-6dfc69ed9403 req-9649479f-0db5-48b6-bd1c-58ed1f67d480 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:49.867756 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-47cf8ec1-1416-45c5-b222-6dfc69ed9403 req-9649479f-0db5-48b6-bd1c-58ed1f67d480 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:49.878399 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-47cf8ec1-1416-45c5-b222-6dfc69ed9403 req-9649479f-0db5-48b6-bd1c-58ed1f67d480 service nova] Creating event network-changed:8e2ef947-6068-4749-9d9a-60018117a9f9 for instance 2aa24417-8c8d-4180-9f39-d8267f508448 on hv-cinder-85220 Aug 18 14:36:49.884240 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-47cf8ec1-1416-45c5-b222-6dfc69ed9403 req-9649479f-0db5-48b6-bd1c-58ed1f67d480 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088313 Aug 18 14:36:49.884934 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 498/1003] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:36:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:36:50.074980 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4f105408-d53b-42d5-ab86-4d11960d7935 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:50.076253 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4f105408-d53b-42d5-ab86-4d11960d7935 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:50.084018 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f105408-d53b-42d5-ab86-4d11960d7935 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:50.084710 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f105408-d53b-42d5-ab86-4d11960d7935 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:50.085339 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f105408-d53b-42d5-ab86-4d11960d7935 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:50.086228 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f105408-d53b-42d5-ab86-4d11960d7935 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:50.086850 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f105408-d53b-42d5-ab86-4d11960d7935 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:50.087731 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f105408-d53b-42d5-ab86-4d11960d7935 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:50.092562 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:36:50.309862 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4f105408-d53b-42d5-ab86-4d11960d7935 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:50.319112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4f105408-d53b-42d5-ab86-4d11960d7935 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1453 microversion: 2.1 time: 0.249195 Aug 18 14:36:50.319923 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 506/1004] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:50 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1453 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:50.345260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a61b9f74-87e1-43b9-b13f-e09ec009da85 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:36:50.345971 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a61b9f74-87e1-43b9-b13f-e09ec009da85 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:36:50.353088 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a61b9f74-87e1-43b9-b13f-e09ec009da85 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:50.353858 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a61b9f74-87e1-43b9-b13f-e09ec009da85 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:50.354465 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a61b9f74-87e1-43b9-b13f-e09ec009da85 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:50.357795 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a61b9f74-87e1-43b9-b13f-e09ec009da85 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:50.358284 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a61b9f74-87e1-43b9-b13f-e09ec009da85 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:50.358730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a61b9f74-87e1-43b9-b13f-e09ec009da85 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:50.507106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a61b9f74-87e1-43b9-b13f-e09ec009da85 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:36:50.516060 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a61b9f74-87e1-43b9-b13f-e09ec009da85 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1453 microversion: 2.1 time: 0.174976 Aug 18 14:36:50.516996 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 499/1005] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:36:50 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:36:52.153663 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-b74edc90-b761-4c1a-8ae5-f24b01b4c1cb req-ed83d939-d6c3-4e83-bddf-c75ce9bf5a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ab7dd8d-369d-4bb1-b967-9154b171fb28", "tag": "8bad3cf2-cd2d-486e-b0f8-017d64cb688d"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:36:52.163844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b74edc90-b761-4c1a-8ae5-f24b01b4c1cb req-ed83d939-d6c3-4e83-bddf-c75ce9bf5a1f service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:36:52.164412 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b74edc90-b761-4c1a-8ae5-f24b01b4c1cb req-ed83d939-d6c3-4e83-bddf-c75ce9bf5a1f service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:36:52.164943 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b74edc90-b761-4c1a-8ae5-f24b01b4c1cb req-ed83d939-d6c3-4e83-bddf-c75ce9bf5a1f service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:36:52.176316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-b74edc90-b761-4c1a-8ae5-f24b01b4c1cb req-ed83d939-d6c3-4e83-bddf-c75ce9bf5a1f service nova] Creating event network-changed:8bad3cf2-cd2d-486e-b0f8-017d64cb688d for instance 3ab7dd8d-369d-4bb1-b967-9154b171fb28 on hv-cinder-85220 Aug 18 14:36:52.181606 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-b74edc90-b761-4c1a-8ae5-f24b01b4c1cb req-ed83d939-d6c3-4e83-bddf-c75ce9bf5a1f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031611 Aug 18 14:36:52.182184 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 507/1006] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:38:31.088426 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 14:38:31.089189 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Thu Aug 18 14:38:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 14:38:31.466970 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 14:38:31.467504 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Thu Aug 18 14:38:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 14:38:37.998065 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR oslo.messaging._drivers.impl_rabbit [-] [426f2db8-03cf-4ba2-b4c3-7cff25150109] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 18 14:38:37.998970 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:38:37.999758 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=24 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:38:38.004557 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1747872782", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1701044862", "security_groups": [{"name": "tempest-secgroup-smoke-1339569545"}], "block_device_mapping_v2": [{"uuid": "e18490ba-ad7d-4529-b505-74657b27180c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "95ff3be2-bdc5-4aad-b19b-f4b034623f47"}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:38:38.126472 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] validate_networks() for [('95ff3be2-bdc5-4aad-b19b-f4b034623f47', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 14:38:38.553793 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 14:38:38.554220 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 14:38:38.554696 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 14:38:38.555111 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 14:38:38.555585 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 14:38:38.565250 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:38.565729 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:38.566165 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:38.566925 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:38.567401 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:38.567830 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:38.584330 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Getting quotas for project e87465b1253547a49284b8be4673305d. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 14:38:38.589371 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Getting quotas for user 3191363bf5794cfd91926141994e9d6b and project e87465b1253547a49284b8be4673305d. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 14:38:38.644707 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 14:38:38.647203 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e18490ba-ad7d-4529-b505-74657b27180c',volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 14:38:38.777677 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-703dddd1-9378-40d9-a239-ff5b720ef7d7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.781206 Aug 18 14:38:38.778491 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 500/1007] 10.222.0.39 () {60 vars in 1147 bytes} [Thu Aug 18 14:38:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 14:38:38.787458 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR oslo.messaging._drivers.impl_rabbit [-] [93796803-991a-45bd-9025-42655323cdf5] AMQP server on 10.222.0.39:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 18 14:38:38.788140 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:38:38.789035 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:38:38.794077 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-983d3209-9d86-4de2-b30a-040ae7daf1a6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:38.794787 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-983d3209-9d86-4de2-b30a-040ae7daf1a6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:38.850263 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-983d3209-9d86-4de2-b30a-040ae7daf1a6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:38.857846 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-983d3209-9d86-4de2-b30a-040ae7daf1a6 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1095 microversion: 2.1 time: 0.072329 Aug 18 14:38:38.858410 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 508/1008] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:38 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:39.878954 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-412dc416-13e5-4605-89cd-4e6e67b13298 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:39.879675 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-412dc416-13e5-4605-89cd-4e6e67b13298 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:39.888205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-412dc416-13e5-4605-89cd-4e6e67b13298 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:39.888695 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-412dc416-13e5-4605-89cd-4e6e67b13298 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:39.889136 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-412dc416-13e5-4605-89cd-4e6e67b13298 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:39.889848 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-412dc416-13e5-4605-89cd-4e6e67b13298 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:39.890311 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-412dc416-13e5-4605-89cd-4e6e67b13298 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:39.890745 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-412dc416-13e5-4605-89cd-4e6e67b13298 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:39.895988 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] [426f2db8-03cf-4ba2-b4c3-7cff25150109] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47072. Aug 18 14:38:39.955822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-412dc416-13e5-4605-89cd-4e6e67b13298 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:39.965018 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-412dc416-13e5-4605-89cd-4e6e67b13298 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1211 microversion: 2.1 time: 0.090808 Aug 18 14:38:39.965601 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 501/1009] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:39 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:40.988271 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a6a29305-f3aa-413d-9c57-079644faba60 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:40.988865 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a6a29305-f3aa-413d-9c57-079644faba60 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:41.001647 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] [93796803-991a-45bd-9025-42655323cdf5] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 47076. Aug 18 14:38:41.008749 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6a29305-f3aa-413d-9c57-079644faba60 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:41.008749 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6a29305-f3aa-413d-9c57-079644faba60 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:41.008749 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6a29305-f3aa-413d-9c57-079644faba60 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:41.009142 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6a29305-f3aa-413d-9c57-079644faba60 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:41.009468 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6a29305-f3aa-413d-9c57-079644faba60 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:41.010987 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6a29305-f3aa-413d-9c57-079644faba60 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:41.016109 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-04023e3c-db80-47f7-a873-36515df673a1 req-e4df7568-a095-4e28-91b8-45a73a943834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82de84e4-7336-4177-8dbc-fc57e2391d77", "tag": "cf7a2b5c-1c47-47da-92cb-fc9af351530b"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:38:41.029961 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-04023e3c-db80-47f7-a873-36515df673a1 req-e4df7568-a095-4e28-91b8-45a73a943834 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:41.030895 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-04023e3c-db80-47f7-a873-36515df673a1 req-e4df7568-a095-4e28-91b8-45a73a943834 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:41.032450 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-04023e3c-db80-47f7-a873-36515df673a1 req-e4df7568-a095-4e28-91b8-45a73a943834 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:41.048186 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-04023e3c-db80-47f7-a873-36515df673a1 req-e4df7568-a095-4e28-91b8-45a73a943834 service nova] Creating event network-changed:cf7a2b5c-1c47-47da-92cb-fc9af351530b for instance 82de84e4-7336-4177-8dbc-fc57e2391d77 on hv-cinder-85220 Aug 18 14:38:41.053681 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-04023e3c-db80-47f7-a873-36515df673a1 req-e4df7568-a095-4e28-91b8-45a73a943834 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041723 Aug 18 14:38:41.054495 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 502/1010] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:38:41.251628 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a6a29305-f3aa-413d-9c57-079644faba60 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:41.259602 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a6a29305-f3aa-413d-9c57-079644faba60 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1267 microversion: 2.1 time: 0.275783 Aug 18 14:38:41.260330 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 509/1011] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:40 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1267 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:42.284775 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4ac9ec63-53b5-4b13-9b9f-98b6adba0f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:42.285466 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4ac9ec63-53b5-4b13-9b9f-98b6adba0f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:42.292084 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ac9ec63-53b5-4b13-9b9f-98b6adba0f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:42.292571 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ac9ec63-53b5-4b13-9b9f-98b6adba0f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:42.293008 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ac9ec63-53b5-4b13-9b9f-98b6adba0f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:42.293707 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ac9ec63-53b5-4b13-9b9f-98b6adba0f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:42.294161 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ac9ec63-53b5-4b13-9b9f-98b6adba0f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:42.294588 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ac9ec63-53b5-4b13-9b9f-98b6adba0f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:42.424809 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4ac9ec63-53b5-4b13-9b9f-98b6adba0f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:42.433180 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4ac9ec63-53b5-4b13-9b9f-98b6adba0f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1267 microversion: 2.1 time: 0.153274 Aug 18 14:38:42.433743 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 503/1012] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:42 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:43.454420 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-470d694a-ee76-4a70-86e2-e08e80513f40 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:43.455036 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-470d694a-ee76-4a70-86e2-e08e80513f40 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:43.461488 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-470d694a-ee76-4a70-86e2-e08e80513f40 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:43.461967 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-470d694a-ee76-4a70-86e2-e08e80513f40 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:43.462398 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-470d694a-ee76-4a70-86e2-e08e80513f40 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:43.463419 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-470d694a-ee76-4a70-86e2-e08e80513f40 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:43.463932 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-470d694a-ee76-4a70-86e2-e08e80513f40 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:43.464355 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-470d694a-ee76-4a70-86e2-e08e80513f40 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:43.594992 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-470d694a-ee76-4a70-86e2-e08e80513f40 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:43.602951 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-470d694a-ee76-4a70-86e2-e08e80513f40 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1267 microversion: 2.1 time: 0.152426 Aug 18 14:38:43.604128 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 510/1013] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:43 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:44.624589 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-43d258f9-20b8-4736-a95b-2b616c513667 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:44.627583 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-43d258f9-20b8-4736-a95b-2b616c513667 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:44.631894 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43d258f9-20b8-4736-a95b-2b616c513667 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:44.632379 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43d258f9-20b8-4736-a95b-2b616c513667 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:44.632821 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43d258f9-20b8-4736-a95b-2b616c513667 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:44.633518 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43d258f9-20b8-4736-a95b-2b616c513667 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:44.633977 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43d258f9-20b8-4736-a95b-2b616c513667 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:44.634414 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43d258f9-20b8-4736-a95b-2b616c513667 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:44.770291 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-43d258f9-20b8-4736-a95b-2b616c513667 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:44.778792 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-43d258f9-20b8-4736-a95b-2b616c513667 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1267 microversion: 2.1 time: 0.158149 Aug 18 14:38:44.779359 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 504/1014] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:44 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:45.799037 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e923be95-8acd-4cff-8921-b0b9b99a4d10 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:45.799676 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e923be95-8acd-4cff-8921-b0b9b99a4d10 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:45.806037 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e923be95-8acd-4cff-8921-b0b9b99a4d10 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:45.806520 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e923be95-8acd-4cff-8921-b0b9b99a4d10 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:45.807910 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e923be95-8acd-4cff-8921-b0b9b99a4d10 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:45.808600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e923be95-8acd-4cff-8921-b0b9b99a4d10 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:45.809053 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e923be95-8acd-4cff-8921-b0b9b99a4d10 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:45.809476 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e923be95-8acd-4cff-8921-b0b9b99a4d10 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:45.941080 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e923be95-8acd-4cff-8921-b0b9b99a4d10 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:45.948826 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e923be95-8acd-4cff-8921-b0b9b99a4d10 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1267 microversion: 2.1 time: 0.153649 Aug 18 14:38:45.949384 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 511/1015] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:45 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:46.969634 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2e8b3832-8d62-4045-bbb4-28eb8c092b99 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:46.970250 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2e8b3832-8d62-4045-bbb4-28eb8c092b99 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:46.976862 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e8b3832-8d62-4045-bbb4-28eb8c092b99 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:46.977342 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e8b3832-8d62-4045-bbb4-28eb8c092b99 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:46.977771 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e8b3832-8d62-4045-bbb4-28eb8c092b99 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:46.978483 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e8b3832-8d62-4045-bbb4-28eb8c092b99 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:46.978942 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e8b3832-8d62-4045-bbb4-28eb8c092b99 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:46.979361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e8b3832-8d62-4045-bbb4-28eb8c092b99 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:47.102469 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7049804e-ca12-4b77-b8bb-0344ba75d512 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:38:47.103038 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7049804e-ca12-4b77-b8bb-0344ba75d512 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:47.109919 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7049804e-ca12-4b77-b8bb-0344ba75d512 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:47.110528 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7049804e-ca12-4b77-b8bb-0344ba75d512 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:47.110968 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7049804e-ca12-4b77-b8bb-0344ba75d512 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:47.111723 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7049804e-ca12-4b77-b8bb-0344ba75d512 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:47.112178 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7049804e-ca12-4b77-b8bb-0344ba75d512 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:47.112600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7049804e-ca12-4b77-b8bb-0344ba75d512 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:47.113283 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2e8b3832-8d62-4045-bbb4-28eb8c092b99 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:47.121983 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2e8b3832-8d62-4045-bbb4-28eb8c092b99 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1267 microversion: 2.1 time: 0.156189 Aug 18 14:38:47.122556 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 505/1016] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:46 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:47.136492 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-7049804e-ca12-4b77-b8bb-0344ba75d512 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lazy-loading 'flavor' on Instance uuid 2aa24417-8c8d-4180-9f39-d8267f508448 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:38:47.206565 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7049804e-ca12-4b77-b8bb-0344ba75d512 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "POST /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448/action" status: 202 len: 0 microversion: 2.1 time: 0.107812 Aug 18 14:38:47.207144 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 512/1017] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:38:47 2022] POST /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 14:38:47.215884 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-288aefb6-a743-4cf6-a12a-841dfb7a435c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:47.216542 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-288aefb6-a743-4cf6-a12a-841dfb7a435c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:47.222488 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-288aefb6-a743-4cf6-a12a-841dfb7a435c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:47.222907 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-288aefb6-a743-4cf6-a12a-841dfb7a435c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:47.223349 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-288aefb6-a743-4cf6-a12a-841dfb7a435c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:47.224061 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-288aefb6-a743-4cf6-a12a-841dfb7a435c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:47.224515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-288aefb6-a743-4cf6-a12a-841dfb7a435c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:47.224943 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-288aefb6-a743-4cf6-a12a-841dfb7a435c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:47.364887 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-288aefb6-a743-4cf6-a12a-841dfb7a435c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:47.373349 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-288aefb6-a743-4cf6-a12a-841dfb7a435c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1568 microversion: 2.1 time: 0.161825 Aug 18 14:38:47.373950 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 506/1018] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:47 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:48.143842 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-97fe9402-c369-4c63-931c-cd39dbc41eaa tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:48.144460 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-97fe9402-c369-4c63-931c-cd39dbc41eaa tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:48.151180 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97fe9402-c369-4c63-931c-cd39dbc41eaa tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:48.151690 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97fe9402-c369-4c63-931c-cd39dbc41eaa tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:48.152126 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97fe9402-c369-4c63-931c-cd39dbc41eaa tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:48.152818 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97fe9402-c369-4c63-931c-cd39dbc41eaa tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:48.153271 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97fe9402-c369-4c63-931c-cd39dbc41eaa tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:48.153693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97fe9402-c369-4c63-931c-cd39dbc41eaa tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:48.287958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97fe9402-c369-4c63-931c-cd39dbc41eaa tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:48.296600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-97fe9402-c369-4c63-931c-cd39dbc41eaa tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1267 microversion: 2.1 time: 0.157470 Aug 18 14:38:48.297175 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 513/1019] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:48 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:48.394307 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5cc94e4c-7320-4959-85d0-c3bce871236f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:48.394861 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5cc94e4c-7320-4959-85d0-c3bce871236f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:48.401621 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cc94e4c-7320-4959-85d0-c3bce871236f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:48.402106 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cc94e4c-7320-4959-85d0-c3bce871236f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:48.402540 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cc94e4c-7320-4959-85d0-c3bce871236f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:48.403242 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cc94e4c-7320-4959-85d0-c3bce871236f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:48.403718 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cc94e4c-7320-4959-85d0-c3bce871236f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:48.404147 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cc94e4c-7320-4959-85d0-c3bce871236f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:48.536572 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5cc94e4c-7320-4959-85d0-c3bce871236f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:48.544830 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5cc94e4c-7320-4959-85d0-c3bce871236f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1568 microversion: 2.1 time: 0.154446 Aug 18 14:38:48.545395 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 507/1020] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:48 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:49.318123 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-070adc9a-77ea-4173-94cc-49a17d5fb052 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:49.318743 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-070adc9a-77ea-4173-94cc-49a17d5fb052 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:49.320779 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:38:49.326568 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-070adc9a-77ea-4173-94cc-49a17d5fb052 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:49.327051 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-070adc9a-77ea-4173-94cc-49a17d5fb052 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:49.327521 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-070adc9a-77ea-4173-94cc-49a17d5fb052 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:49.328216 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-070adc9a-77ea-4173-94cc-49a17d5fb052 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:49.328675 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-070adc9a-77ea-4173-94cc-49a17d5fb052 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:49.329105 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-070adc9a-77ea-4173-94cc-49a17d5fb052 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:49.461781 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-070adc9a-77ea-4173-94cc-49a17d5fb052 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:49.470526 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-070adc9a-77ea-4173-94cc-49a17d5fb052 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1267 microversion: 2.1 time: 0.156352 Aug 18 14:38:49.471112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 514/1021] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:49 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:38:49.566257 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-144933c2-aab3-40dd-9c05-00aeccd860f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:49.566914 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-144933c2-aab3-40dd-9c05-00aeccd860f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:49.568895 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:38:49.569558 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:38:49.576357 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-144933c2-aab3-40dd-9c05-00aeccd860f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:49.576836 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-144933c2-aab3-40dd-9c05-00aeccd860f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:49.577272 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-144933c2-aab3-40dd-9c05-00aeccd860f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:49.577968 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-144933c2-aab3-40dd-9c05-00aeccd860f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:49.578425 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-144933c2-aab3-40dd-9c05-00aeccd860f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:49.578851 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-144933c2-aab3-40dd-9c05-00aeccd860f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:49.714933 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-144933c2-aab3-40dd-9c05-00aeccd860f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:49.722748 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-144933c2-aab3-40dd-9c05-00aeccd860f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1568 microversion: 2.1 time: 0.160405 Aug 18 14:38:49.723316 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 508/1022] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:49 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:50.253244 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-15e286d7-9e97-48b7-b733-d1bc51ce4987 req-fc8ebdfb-7dda-4643-9cea-bb7497fa54fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82de84e4-7336-4177-8dbc-fc57e2391d77", "name": "network-vif-plugged", "status": "completed", "tag": "cf7a2b5c-1c47-47da-92cb-fc9af351530b"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:38:50.264676 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-15e286d7-9e97-48b7-b733-d1bc51ce4987 req-fc8ebdfb-7dda-4643-9cea-bb7497fa54fc service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:50.265392 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-15e286d7-9e97-48b7-b733-d1bc51ce4987 req-fc8ebdfb-7dda-4643-9cea-bb7497fa54fc service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:50.267207 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-15e286d7-9e97-48b7-b733-d1bc51ce4987 req-fc8ebdfb-7dda-4643-9cea-bb7497fa54fc service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:50.278991 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-15e286d7-9e97-48b7-b733-d1bc51ce4987 req-fc8ebdfb-7dda-4643-9cea-bb7497fa54fc service nova] Creating event network-vif-plugged:cf7a2b5c-1c47-47da-92cb-fc9af351530b for instance 82de84e4-7336-4177-8dbc-fc57e2391d77 on hv-cinder-85220 Aug 18 14:38:50.284012 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-15e286d7-9e97-48b7-b733-d1bc51ce4987 req-fc8ebdfb-7dda-4643-9cea-bb7497fa54fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034405 Aug 18 14:38:50.284889 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 515/1023] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:38:50.492185 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6b0d0bd1-cea4-4699-a144-9b9ca80323b2 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:50.492947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6b0d0bd1-cea4-4699-a144-9b9ca80323b2 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:50.499641 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b0d0bd1-cea4-4699-a144-9b9ca80323b2 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:50.500138 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b0d0bd1-cea4-4699-a144-9b9ca80323b2 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:50.500581 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b0d0bd1-cea4-4699-a144-9b9ca80323b2 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:50.501282 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b0d0bd1-cea4-4699-a144-9b9ca80323b2 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:50.501745 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b0d0bd1-cea4-4699-a144-9b9ca80323b2 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:50.502746 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b0d0bd1-cea4-4699-a144-9b9ca80323b2 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:50.643869 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6b0d0bd1-cea4-4699-a144-9b9ca80323b2 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:50.651805 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6b0d0bd1-cea4-4699-a144-9b9ca80323b2 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1267 microversion: 2.1 time: 0.163587 Aug 18 14:38:50.652586 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 509/1024] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:50 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:50.745551 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0b215efa-ecf9-4a4e-8dfb-3e4d59ad788f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:50.746383 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0b215efa-ecf9-4a4e-8dfb-3e4d59ad788f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:50.752650 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b215efa-ecf9-4a4e-8dfb-3e4d59ad788f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:50.753134 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b215efa-ecf9-4a4e-8dfb-3e4d59ad788f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:50.753575 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b215efa-ecf9-4a4e-8dfb-3e4d59ad788f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:50.754261 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b215efa-ecf9-4a4e-8dfb-3e4d59ad788f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:50.754709 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b215efa-ecf9-4a4e-8dfb-3e4d59ad788f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:50.755290 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b215efa-ecf9-4a4e-8dfb-3e4d59ad788f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:50.888448 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0b215efa-ecf9-4a4e-8dfb-3e4d59ad788f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:50.896151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0b215efa-ecf9-4a4e-8dfb-3e4d59ad788f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1568 microversion: 2.1 time: 0.156237 Aug 18 14:38:50.896709 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 516/1025] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:50 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:51.673465 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-22f49c73-e851-48aa-87fb-69b354be2b0a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:51.673992 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-22f49c73-e851-48aa-87fb-69b354be2b0a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:51.680549 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22f49c73-e851-48aa-87fb-69b354be2b0a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:51.681037 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22f49c73-e851-48aa-87fb-69b354be2b0a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:51.681503 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22f49c73-e851-48aa-87fb-69b354be2b0a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:51.682565 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22f49c73-e851-48aa-87fb-69b354be2b0a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:51.682896 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22f49c73-e851-48aa-87fb-69b354be2b0a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:51.683329 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22f49c73-e851-48aa-87fb-69b354be2b0a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:51.814833 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-22f49c73-e851-48aa-87fb-69b354be2b0a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:51.823278 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-22f49c73-e851-48aa-87fb-69b354be2b0a tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1267 microversion: 2.1 time: 0.153686 Aug 18 14:38:51.823888 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 510/1026] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:51 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:51.918289 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0372a62a-fc65-46ca-ac6d-b01b03925837 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:51.918906 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0372a62a-fc65-46ca-ac6d-b01b03925837 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:51.925795 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0372a62a-fc65-46ca-ac6d-b01b03925837 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:51.926221 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0372a62a-fc65-46ca-ac6d-b01b03925837 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:51.926646 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0372a62a-fc65-46ca-ac6d-b01b03925837 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:51.927337 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0372a62a-fc65-46ca-ac6d-b01b03925837 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:51.927807 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0372a62a-fc65-46ca-ac6d-b01b03925837 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:51.928228 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0372a62a-fc65-46ca-ac6d-b01b03925837 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:52.062684 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0372a62a-fc65-46ca-ac6d-b01b03925837 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:52.070735 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0372a62a-fc65-46ca-ac6d-b01b03925837 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1568 microversion: 2.1 time: 0.156907 Aug 18 14:38:52.071295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 517/1027] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:51 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:52.844911 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8db7160f-1094-4a0b-8b42-626e14b78b54 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:52.845526 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8db7160f-1094-4a0b-8b42-626e14b78b54 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:52.851998 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8db7160f-1094-4a0b-8b42-626e14b78b54 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:52.852481 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8db7160f-1094-4a0b-8b42-626e14b78b54 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:52.852913 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8db7160f-1094-4a0b-8b42-626e14b78b54 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:52.854364 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8db7160f-1094-4a0b-8b42-626e14b78b54 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:52.854822 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8db7160f-1094-4a0b-8b42-626e14b78b54 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:52.855252 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8db7160f-1094-4a0b-8b42-626e14b78b54 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:52.988104 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8db7160f-1094-4a0b-8b42-626e14b78b54 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:52.995848 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8db7160f-1094-4a0b-8b42-626e14b78b54 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1454 microversion: 2.1 time: 0.154831 Aug 18 14:38:52.996412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 511/1028] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:52 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:53.015654 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d6e8b92b-3622-4551-aa72-7c5dd85f901c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:53.016274 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d6e8b92b-3622-4551-aa72-7c5dd85f901c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:53.022700 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6e8b92b-3622-4551-aa72-7c5dd85f901c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:53.023184 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6e8b92b-3622-4551-aa72-7c5dd85f901c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:53.023726 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6e8b92b-3622-4551-aa72-7c5dd85f901c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:53.024427 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6e8b92b-3622-4551-aa72-7c5dd85f901c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:53.024884 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6e8b92b-3622-4551-aa72-7c5dd85f901c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:53.025866 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6e8b92b-3622-4551-aa72-7c5dd85f901c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:53.092617 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fc1b58a7-8bc3-4d2e-85a6-9afa58c5f171 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:53.093236 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fc1b58a7-8bc3-4d2e-85a6-9afa58c5f171 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:53.099261 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc1b58a7-8bc3-4d2e-85a6-9afa58c5f171 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:53.099722 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc1b58a7-8bc3-4d2e-85a6-9afa58c5f171 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:53.100164 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc1b58a7-8bc3-4d2e-85a6-9afa58c5f171 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:53.100865 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc1b58a7-8bc3-4d2e-85a6-9afa58c5f171 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:53.101322 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc1b58a7-8bc3-4d2e-85a6-9afa58c5f171 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:53.101755 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc1b58a7-8bc3-4d2e-85a6-9afa58c5f171 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:53.156911 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d6e8b92b-3622-4551-aa72-7c5dd85f901c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:53.164680 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d6e8b92b-3622-4551-aa72-7c5dd85f901c tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1454 microversion: 2.1 time: 0.152964 Aug 18 14:38:53.165488 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 518/1029] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:53 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:53.236260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fc1b58a7-8bc3-4d2e-85a6-9afa58c5f171 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:53.244164 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fc1b58a7-8bc3-4d2e-85a6-9afa58c5f171 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1568 microversion: 2.1 time: 0.156159 Aug 18 14:38:53.245132 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 512/1030] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:53 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 14:38:54.266577 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ddcd8c51-cf9a-4432-b759-bddc55ff48f7 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:54.267213 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ddcd8c51-cf9a-4432-b759-bddc55ff48f7 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:54.273863 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddcd8c51-cf9a-4432-b759-bddc55ff48f7 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:54.274346 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddcd8c51-cf9a-4432-b759-bddc55ff48f7 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:54.274780 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddcd8c51-cf9a-4432-b759-bddc55ff48f7 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:54.276058 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddcd8c51-cf9a-4432-b759-bddc55ff48f7 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:54.276516 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddcd8c51-cf9a-4432-b759-bddc55ff48f7 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:54.276955 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddcd8c51-cf9a-4432-b759-bddc55ff48f7 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:54.485651 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ddcd8c51-cf9a-4432-b759-bddc55ff48f7 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:54.493522 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ddcd8c51-cf9a-4432-b759-bddc55ff48f7 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1568 microversion: 2.1 time: 0.230792 Aug 18 14:38:54.494644 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 519/1031] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:54 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:55.062935 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-5af54730-7cbb-41f4-8bb7-52b0297c99c6 req-fb1880c9-6152-441b-81f6-63bacf94ee9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82de84e4-7336-4177-8dbc-fc57e2391d77", "tag": "cf7a2b5c-1c47-47da-92cb-fc9af351530b"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:38:55.073420 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5af54730-7cbb-41f4-8bb7-52b0297c99c6 req-fb1880c9-6152-441b-81f6-63bacf94ee9a service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:55.073904 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5af54730-7cbb-41f4-8bb7-52b0297c99c6 req-fb1880c9-6152-441b-81f6-63bacf94ee9a service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:55.074343 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-5af54730-7cbb-41f4-8bb7-52b0297c99c6 req-fb1880c9-6152-441b-81f6-63bacf94ee9a service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:55.085801 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-5af54730-7cbb-41f4-8bb7-52b0297c99c6 req-fb1880c9-6152-441b-81f6-63bacf94ee9a service nova] Creating event network-changed:cf7a2b5c-1c47-47da-92cb-fc9af351530b for instance 82de84e4-7336-4177-8dbc-fc57e2391d77 on hv-cinder-85220 Aug 18 14:38:55.091845 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-5af54730-7cbb-41f4-8bb7-52b0297c99c6 req-fb1880c9-6152-441b-81f6-63bacf94ee9a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032691 Aug 18 14:38:55.092645 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 513/1032] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:38:55.514729 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e495f627-50e9-4b88-8885-498869bee4b5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:55.515341 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e495f627-50e9-4b88-8885-498869bee4b5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:55.521731 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e495f627-50e9-4b88-8885-498869bee4b5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:55.522207 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e495f627-50e9-4b88-8885-498869bee4b5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:55.522636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e495f627-50e9-4b88-8885-498869bee4b5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:55.523323 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e495f627-50e9-4b88-8885-498869bee4b5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:55.523816 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e495f627-50e9-4b88-8885-498869bee4b5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:55.524238 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e495f627-50e9-4b88-8885-498869bee4b5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:55.704723 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e495f627-50e9-4b88-8885-498869bee4b5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:55.712909 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e495f627-50e9-4b88-8885-498869bee4b5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1568 microversion: 2.1 time: 0.202507 Aug 18 14:38:55.713740 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 520/1033] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:55 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:56.735188 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2bb60a58-4117-4573-8098-1b826ef69626 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:56.735904 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2bb60a58-4117-4573-8098-1b826ef69626 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:56.742062 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bb60a58-4117-4573-8098-1b826ef69626 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:56.742578 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bb60a58-4117-4573-8098-1b826ef69626 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:56.743011 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bb60a58-4117-4573-8098-1b826ef69626 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:56.743722 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bb60a58-4117-4573-8098-1b826ef69626 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:56.744959 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bb60a58-4117-4573-8098-1b826ef69626 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:56.745472 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bb60a58-4117-4573-8098-1b826ef69626 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:56.880380 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2bb60a58-4117-4573-8098-1b826ef69626 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:56.888755 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2bb60a58-4117-4573-8098-1b826ef69626 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1568 microversion: 2.1 time: 0.158299 Aug 18 14:38:56.889327 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 514/1034] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:56 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:57.909745 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-68938dbd-3b58-4b97-a8d5-98eb2382aa80 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:57.910364 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-68938dbd-3b58-4b97-a8d5-98eb2382aa80 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:57.917103 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68938dbd-3b58-4b97-a8d5-98eb2382aa80 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:57.917580 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68938dbd-3b58-4b97-a8d5-98eb2382aa80 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:57.918012 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68938dbd-3b58-4b97-a8d5-98eb2382aa80 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:57.918699 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68938dbd-3b58-4b97-a8d5-98eb2382aa80 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:57.919147 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68938dbd-3b58-4b97-a8d5-98eb2382aa80 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:57.919673 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68938dbd-3b58-4b97-a8d5-98eb2382aa80 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:58.137406 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-68938dbd-3b58-4b97-a8d5-98eb2382aa80 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:58.145221 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-68938dbd-3b58-4b97-a8d5-98eb2382aa80 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1568 microversion: 2.1 time: 0.239544 Aug 18 14:38:58.145794 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 521/1035] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:57 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:38:59.165287 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c0c929e4-14ad-44e4-89e8-a1efab82dee0 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:38:59.165943 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c0c929e4-14ad-44e4-89e8-a1efab82dee0 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:38:59.173101 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0c929e4-14ad-44e4-89e8-a1efab82dee0 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:59.173586 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0c929e4-14ad-44e4-89e8-a1efab82dee0 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:59.174025 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0c929e4-14ad-44e4-89e8-a1efab82dee0 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:59.174721 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0c929e4-14ad-44e4-89e8-a1efab82dee0 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:38:59.175170 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0c929e4-14ad-44e4-89e8-a1efab82dee0 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:38:59.175643 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0c929e4-14ad-44e4-89e8-a1efab82dee0 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:38:59.310234 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c0c929e4-14ad-44e4-89e8-a1efab82dee0 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:38:59.318318 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c0c929e4-14ad-44e4-89e8-a1efab82dee0 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1568 microversion: 2.1 time: 0.156995 Aug 18 14:38:59.318885 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 515/1036] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:38:59 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:39:00.341194 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2ee54a3b-73ac-4a77-b4db-e1f628976e22 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:39:00.341812 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2ee54a3b-73ac-4a77-b4db-e1f628976e22 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:39:00.348334 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ee54a3b-73ac-4a77-b4db-e1f628976e22 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:00.348815 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ee54a3b-73ac-4a77-b4db-e1f628976e22 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:00.349260 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ee54a3b-73ac-4a77-b4db-e1f628976e22 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:00.349956 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ee54a3b-73ac-4a77-b4db-e1f628976e22 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:00.350413 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ee54a3b-73ac-4a77-b4db-e1f628976e22 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:00.350851 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ee54a3b-73ac-4a77-b4db-e1f628976e22 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:00.488620 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2ee54a3b-73ac-4a77-b4db-e1f628976e22 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:39:00.497038 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2ee54a3b-73ac-4a77-b4db-e1f628976e22 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1569 microversion: 2.1 time: 0.160640 Aug 18 14:39:00.497605 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 522/1037] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:39:00 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:39:00.518339 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-017a692f-d68e-4040-a701-36c2bb983c8a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:39:00.518939 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-017a692f-d68e-4040-a701-36c2bb983c8a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:39:00.525511 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-017a692f-d68e-4040-a701-36c2bb983c8a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:00.526245 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-017a692f-d68e-4040-a701-36c2bb983c8a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:00.526688 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-017a692f-d68e-4040-a701-36c2bb983c8a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:00.527406 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-017a692f-d68e-4040-a701-36c2bb983c8a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:00.527866 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-017a692f-d68e-4040-a701-36c2bb983c8a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:00.528295 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-017a692f-d68e-4040-a701-36c2bb983c8a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:00.571084 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-017a692f-d68e-4040-a701-36c2bb983c8a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120539) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 14:39:00.637228 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-017a692f-d68e-4040-a701-36c2bb983c8a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "POST /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448/action" status: 202 len: 0 microversion: 2.1 time: 0.122704 Aug 18 14:39:00.637832 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 516/1038] 10.222.0.39 () {60 vars in 1278 bytes} [Thu Aug 18 14:39:00 2022] POST /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:39:00.645824 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bc820f1d-74a0-48e5-92ca-b4b656947af9 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:39:00.646440 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bc820f1d-74a0-48e5-92ca-b4b656947af9 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:39:00.652699 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc820f1d-74a0-48e5-92ca-b4b656947af9 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:00.653186 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc820f1d-74a0-48e5-92ca-b4b656947af9 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:00.653621 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc820f1d-74a0-48e5-92ca-b4b656947af9 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:00.654317 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc820f1d-74a0-48e5-92ca-b4b656947af9 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:00.655022 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc820f1d-74a0-48e5-92ca-b4b656947af9 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:00.655175 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc820f1d-74a0-48e5-92ca-b4b656947af9 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:00.785971 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bc820f1d-74a0-48e5-92ca-b4b656947af9 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:39:00.794760 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bc820f1d-74a0-48e5-92ca-b4b656947af9 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1517 microversion: 2.1 time: 0.152731 Aug 18 14:39:00.795330 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 523/1039] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:39:00 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:39:01.817605 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9a51f242-ecef-4858-b7d3-945bef606774 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:39:01.818213 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9a51f242-ecef-4858-b7d3-945bef606774 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:39:01.826265 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a51f242-ecef-4858-b7d3-945bef606774 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:01.826754 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a51f242-ecef-4858-b7d3-945bef606774 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:01.827195 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a51f242-ecef-4858-b7d3-945bef606774 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:01.828009 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a51f242-ecef-4858-b7d3-945bef606774 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:01.828471 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a51f242-ecef-4858-b7d3-945bef606774 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:01.828902 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a51f242-ecef-4858-b7d3-945bef606774 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:01.848443 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:39:01.964449 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9a51f242-ecef-4858-b7d3-945bef606774 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:39:01.972193 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9a51f242-ecef-4858-b7d3-945bef606774 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1575 microversion: 2.1 time: 0.159411 Aug 18 14:39:01.972758 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 517/1040] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:39:01 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:39:02.995082 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-53228dc5-cb41-442a-a72c-892652c48021 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:39:02.995821 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-53228dc5-cb41-442a-a72c-892652c48021 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:39:03.002127 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53228dc5-cb41-442a-a72c-892652c48021 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:03.002603 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53228dc5-cb41-442a-a72c-892652c48021 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:03.003032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53228dc5-cb41-442a-a72c-892652c48021 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:03.003743 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53228dc5-cb41-442a-a72c-892652c48021 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:03.004192 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53228dc5-cb41-442a-a72c-892652c48021 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:03.004612 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53228dc5-cb41-442a-a72c-892652c48021 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:03.009096 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:39:03.144923 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-53228dc5-cb41-442a-a72c-892652c48021 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:39:03.152885 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-53228dc5-cb41-442a-a72c-892652c48021 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1575 microversion: 2.1 time: 0.162263 Aug 18 14:39:03.153445 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 524/1041] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:39:02 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:39:04.172804 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-38da8ff8-3fca-4a69-9acd-1fcf946d0e24 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:39:04.173426 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-38da8ff8-3fca-4a69-9acd-1fcf946d0e24 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:39:04.180229 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38da8ff8-3fca-4a69-9acd-1fcf946d0e24 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:04.180700 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38da8ff8-3fca-4a69-9acd-1fcf946d0e24 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:04.181275 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38da8ff8-3fca-4a69-9acd-1fcf946d0e24 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:04.182615 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38da8ff8-3fca-4a69-9acd-1fcf946d0e24 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:04.183175 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38da8ff8-3fca-4a69-9acd-1fcf946d0e24 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:04.183728 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38da8ff8-3fca-4a69-9acd-1fcf946d0e24 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:04.318453 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-38da8ff8-3fca-4a69-9acd-1fcf946d0e24 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:39:04.326594 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-dfc12e46-c200-41cd-afb5-7a54ae7d0cf6 req-8200d449-ad75-4232-ab61-842b1efb709e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa24417-8c8d-4180-9f39-d8267f508448", "name": "network-vif-unplugged", "status": "completed", "tag": "8e2ef947-6068-4749-9d9a-60018117a9f9"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:39:04.327361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-38da8ff8-3fca-4a69-9acd-1fcf946d0e24 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1575 microversion: 2.1 time: 0.158365 Aug 18 14:39:04.328046 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 518/1042] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:39:04 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:39:04.345268 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-dfc12e46-c200-41cd-afb5-7a54ae7d0cf6 req-8200d449-ad75-4232-ab61-842b1efb709e service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:04.345760 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-dfc12e46-c200-41cd-afb5-7a54ae7d0cf6 req-8200d449-ad75-4232-ab61-842b1efb709e service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:04.346195 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-dfc12e46-c200-41cd-afb5-7a54ae7d0cf6 req-8200d449-ad75-4232-ab61-842b1efb709e service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:04.361065 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-dfc12e46-c200-41cd-afb5-7a54ae7d0cf6 req-8200d449-ad75-4232-ab61-842b1efb709e service nova] Creating event network-vif-unplugged:8e2ef947-6068-4749-9d9a-60018117a9f9 for instance 2aa24417-8c8d-4180-9f39-d8267f508448 on hv-cinder-85220 Aug 18 14:39:04.366658 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-dfc12e46-c200-41cd-afb5-7a54ae7d0cf6 req-8200d449-ad75-4232-ab61-842b1efb709e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045218 Aug 18 14:39:04.367562 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 525/1043] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:39:05.349140 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab4efa93-52e4-4974-8ab1-54cee75b4efc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:39:05.349798 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab4efa93-52e4-4974-8ab1-54cee75b4efc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:39:05.356227 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab4efa93-52e4-4974-8ab1-54cee75b4efc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:05.356716 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab4efa93-52e4-4974-8ab1-54cee75b4efc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:05.357156 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab4efa93-52e4-4974-8ab1-54cee75b4efc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:05.357853 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab4efa93-52e4-4974-8ab1-54cee75b4efc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:05.358309 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab4efa93-52e4-4974-8ab1-54cee75b4efc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:05.358737 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab4efa93-52e4-4974-8ab1-54cee75b4efc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:05.493600 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ab4efa93-52e4-4974-8ab1-54cee75b4efc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:39:05.501445 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab4efa93-52e4-4974-8ab1-54cee75b4efc tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1575 microversion: 2.1 time: 0.156208 Aug 18 14:39:05.502009 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 519/1044] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:39:05 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:39:06.523690 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-98b431ad-eb5a-4fa4-b3cf-f8ceef5632d5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:39:06.524316 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-98b431ad-eb5a-4fa4-b3cf-f8ceef5632d5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:39:06.531026 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98b431ad-eb5a-4fa4-b3cf-f8ceef5632d5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:06.531538 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98b431ad-eb5a-4fa4-b3cf-f8ceef5632d5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:06.531983 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98b431ad-eb5a-4fa4-b3cf-f8ceef5632d5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:06.532662 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98b431ad-eb5a-4fa4-b3cf-f8ceef5632d5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:06.533115 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98b431ad-eb5a-4fa4-b3cf-f8ceef5632d5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:06.533539 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98b431ad-eb5a-4fa4-b3cf-f8ceef5632d5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:06.664049 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-98b431ad-eb5a-4fa4-b3cf-f8ceef5632d5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:39:06.672678 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-98b431ad-eb5a-4fa4-b3cf-f8ceef5632d5 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1575 microversion: 2.1 time: 0.153725 Aug 18 14:39:06.673245 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 526/1045] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:39:06 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:39:07.694036 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2b5af248-af1b-4be6-b3c6-fc8d06f882fa tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:39:07.694576 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2b5af248-af1b-4be6-b3c6-fc8d06f882fa tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:39:07.701419 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b5af248-af1b-4be6-b3c6-fc8d06f882fa tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:07.701900 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b5af248-af1b-4be6-b3c6-fc8d06f882fa tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:07.702336 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b5af248-af1b-4be6-b3c6-fc8d06f882fa tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:07.703051 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b5af248-af1b-4be6-b3c6-fc8d06f882fa tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:07.703536 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b5af248-af1b-4be6-b3c6-fc8d06f882fa tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:07.703963 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b5af248-af1b-4be6-b3c6-fc8d06f882fa tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:07.833060 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2b5af248-af1b-4be6-b3c6-fc8d06f882fa tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:39:07.841921 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2b5af248-af1b-4be6-b3c6-fc8d06f882fa tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1575 microversion: 2.1 time: 0.151773 Aug 18 14:39:07.842712 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 520/1046] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:39:07 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:39:08.864740 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-445e736f-effa-4d25-bb25-4a755c7177ef tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:39:08.865356 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-445e736f-effa-4d25-bb25-4a755c7177ef tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:39:08.867806 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=41 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:39:08.873817 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-445e736f-effa-4d25-bb25-4a755c7177ef tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:08.874299 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-445e736f-effa-4d25-bb25-4a755c7177ef tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:08.874738 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-445e736f-effa-4d25-bb25-4a755c7177ef tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:08.875451 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-445e736f-effa-4d25-bb25-4a755c7177ef tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:08.875909 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-445e736f-effa-4d25-bb25-4a755c7177ef tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:08.876336 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-445e736f-effa-4d25-bb25-4a755c7177ef tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:09.005080 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-445e736f-effa-4d25-bb25-4a755c7177ef tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:39:09.013244 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-445e736f-effa-4d25-bb25-4a755c7177ef tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1575 microversion: 2.1 time: 0.152441 Aug 18 14:39:09.013813 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 527/1047] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:39:08 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:39:10.035452 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d910c040-fa4e-44c3-8e2b-71f3f4f31a4f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:39:10.036098 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d910c040-fa4e-44c3-8e2b-71f3f4f31a4f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:39:10.038127 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:39:10.044652 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d910c040-fa4e-44c3-8e2b-71f3f4f31a4f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:10.045137 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d910c040-fa4e-44c3-8e2b-71f3f4f31a4f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:10.045571 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d910c040-fa4e-44c3-8e2b-71f3f4f31a4f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:10.046323 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d910c040-fa4e-44c3-8e2b-71f3f4f31a4f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:10.046805 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d910c040-fa4e-44c3-8e2b-71f3f4f31a4f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:10.047227 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d910c040-fa4e-44c3-8e2b-71f3f4f31a4f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:10.184963 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d910c040-fa4e-44c3-8e2b-71f3f4f31a4f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:39:10.192620 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d910c040-fa4e-44c3-8e2b-71f3f4f31a4f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1562 microversion: 2.1 time: 0.162469 Aug 18 14:39:10.193216 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 521/1048] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:39:10 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:39:12.401987 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-ebec5d4c-0f5b-48ed-8c3e-606eddfb9cf5 req-05baf0fe-9640-48de-ae6a-07bf046a7876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa24417-8c8d-4180-9f39-d8267f508448", "name": "network-vif-plugged", "status": "completed", "tag": "8e2ef947-6068-4749-9d9a-60018117a9f9"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:39:12.412865 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-ebec5d4c-0f5b-48ed-8c3e-606eddfb9cf5 req-05baf0fe-9640-48de-ae6a-07bf046a7876 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:39:12.413324 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-ebec5d4c-0f5b-48ed-8c3e-606eddfb9cf5 req-05baf0fe-9640-48de-ae6a-07bf046a7876 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:39:12.413832 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-ebec5d4c-0f5b-48ed-8c3e-606eddfb9cf5 req-05baf0fe-9640-48de-ae6a-07bf046a7876 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:39:12.427492 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-ebec5d4c-0f5b-48ed-8c3e-606eddfb9cf5 req-05baf0fe-9640-48de-ae6a-07bf046a7876 service nova] Creating event network-vif-plugged:8e2ef947-6068-4749-9d9a-60018117a9f9 for instance 2aa24417-8c8d-4180-9f39-d8267f508448 on hv-cinder-85220 Aug 18 14:39:12.433015 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-ebec5d4c-0f5b-48ed-8c3e-606eddfb9cf5 req-05baf0fe-9640-48de-ae6a-07bf046a7876 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034614 Aug 18 14:39:12.433738 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 528/1049] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:40:24.133598 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:40:24.134407 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=26 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:40:24.136636 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:40:24.137368 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=20 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 14:40:24.138666 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-41fca82a-99bc-4bc5-bb91-4bcbb984faba tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:24.139181 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-41fca82a-99bc-4bc5-bb91-4bcbb984faba tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:24.141878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-5debf3e1-6db2-4158-8e4f-e35d5eca19e2 req-5cf9d9bc-8a08-4064-af9e-c4919eaef161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82de84e4-7336-4177-8dbc-fc57e2391d77", "tag": "cf7a2b5c-1c47-47da-92cb-fc9af351530b"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:40:24.146014 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41fca82a-99bc-4bc5-bb91-4bcbb984faba tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:24.146499 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41fca82a-99bc-4bc5-bb91-4bcbb984faba tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:24.147127 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41fca82a-99bc-4bc5-bb91-4bcbb984faba tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:24.147865 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41fca82a-99bc-4bc5-bb91-4bcbb984faba tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:24.148493 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41fca82a-99bc-4bc5-bb91-4bcbb984faba tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:24.148922 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41fca82a-99bc-4bc5-bb91-4bcbb984faba tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:24.152052 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-5debf3e1-6db2-4158-8e4f-e35d5eca19e2 req-5cf9d9bc-8a08-4064-af9e-c4919eaef161 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:24.152526 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-5debf3e1-6db2-4158-8e4f-e35d5eca19e2 req-5cf9d9bc-8a08-4064-af9e-c4919eaef161 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:24.152959 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-5debf3e1-6db2-4158-8e4f-e35d5eca19e2 req-5cf9d9bc-8a08-4064-af9e-c4919eaef161 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:24.166413 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-5debf3e1-6db2-4158-8e4f-e35d5eca19e2 req-5cf9d9bc-8a08-4064-af9e-c4919eaef161 service nova] Creating event network-changed:cf7a2b5c-1c47-47da-92cb-fc9af351530b for instance 82de84e4-7336-4177-8dbc-fc57e2391d77 on hv-cinder-85220 Aug 18 14:40:24.172808 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-5debf3e1-6db2-4158-8e4f-e35d5eca19e2 req-5cf9d9bc-8a08-4064-af9e-c4919eaef161 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038080 Aug 18 14:40:24.173376 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 529/1050] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:40:24.177996 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-41fca82a-99bc-4bc5-bb91-4bcbb984faba tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:40:24.274927 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-41fca82a-99bc-4bc5-bb91-4bcbb984faba tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "DELETE /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 204 len: 0 microversion: 2.1 time: 0.142977 Aug 18 14:40:24.279160 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 522/1051] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:40:24 2022] DELETE /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:40:24.285397 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bbf732b8-509c-4c47-b922-89b7a3e627a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:24.286637 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bbf732b8-509c-4c47-b922-89b7a3e627a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:24.292759 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbf732b8-509c-4c47-b922-89b7a3e627a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:24.293251 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbf732b8-509c-4c47-b922-89b7a3e627a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:24.293900 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbf732b8-509c-4c47-b922-89b7a3e627a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:24.295132 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbf732b8-509c-4c47-b922-89b7a3e627a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:24.295792 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbf732b8-509c-4c47-b922-89b7a3e627a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:24.296533 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbf732b8-509c-4c47-b922-89b7a3e627a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:24.488399 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bbf732b8-509c-4c47-b922-89b7a3e627a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:40:24.496043 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bbf732b8-509c-4c47-b922-89b7a3e627a7 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1578 microversion: 2.1 time: 0.215293 Aug 18 14:40:24.496609 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 530/1052] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:40:24 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1578 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:40:25.518691 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-717c38ab-c1df-4e72-87a2-de6187b03a9e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:25.519413 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-717c38ab-c1df-4e72-87a2-de6187b03a9e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:25.525815 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717c38ab-c1df-4e72-87a2-de6187b03a9e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:25.526302 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717c38ab-c1df-4e72-87a2-de6187b03a9e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:25.526738 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717c38ab-c1df-4e72-87a2-de6187b03a9e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:25.527471 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717c38ab-c1df-4e72-87a2-de6187b03a9e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:25.527921 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717c38ab-c1df-4e72-87a2-de6187b03a9e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:25.528348 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717c38ab-c1df-4e72-87a2-de6187b03a9e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:25.711259 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-717c38ab-c1df-4e72-87a2-de6187b03a9e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:40:25.719412 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-717c38ab-c1df-4e72-87a2-de6187b03a9e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1578 microversion: 2.1 time: 0.204895 Aug 18 14:40:25.719980 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 523/1053] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:40:25 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1578 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:40:26.343889 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-d2254b88-b048-43ae-b387-b17ee2286d66 req-4fef8759-2485-4f46-b980-e5837de504a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82de84e4-7336-4177-8dbc-fc57e2391d77", "name": "network-vif-deleted", "tag": "cf7a2b5c-1c47-47da-92cb-fc9af351530b"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:40:26.358457 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-d2254b88-b048-43ae-b387-b17ee2286d66 req-4fef8759-2485-4f46-b980-e5837de504a1 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:26.358941 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-d2254b88-b048-43ae-b387-b17ee2286d66 req-4fef8759-2485-4f46-b980-e5837de504a1 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:26.359792 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-d2254b88-b048-43ae-b387-b17ee2286d66 req-4fef8759-2485-4f46-b980-e5837de504a1 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:26.374470 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-d2254b88-b048-43ae-b387-b17ee2286d66 req-4fef8759-2485-4f46-b980-e5837de504a1 service nova] Creating event network-vif-deleted:cf7a2b5c-1c47-47da-92cb-fc9af351530b for instance 82de84e4-7336-4177-8dbc-fc57e2391d77 on hv-cinder-85220 Aug 18 14:40:26.380594 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-d2254b88-b048-43ae-b387-b17ee2286d66 req-4fef8759-2485-4f46-b980-e5837de504a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047034 Aug 18 14:40:26.381529 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 531/1054] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:40:26.741472 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:26.742071 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:26.749478 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:26.749969 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:26.750403 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:26.751116 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:26.751779 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:26.752205 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:26.786669 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:26.787155 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:26.787823 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:26.788332 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lazy-loading 'fault' on Instance uuid 82de84e4-7336-4177-8dbc-fc57e2391d77 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:40:26.834292 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:40:26.842891 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3aaef6f3-1bfe-4f7b-bc79-966b1308325d tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 200 len: 1231 microversion: 2.1 time: 0.105479 Aug 18 14:40:26.843481 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 524/1055] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:40:26 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:40:26.889464 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a5fa4c56-effd-4dea-9c26-e82d1ecca6f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:26.890423 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-08846917-26ce-42a2-9d28-4f2940cc2d6c req-07b2db82-8b78-464c-94e2-7abb32231082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aa24417-8c8d-4180-9f39-d8267f508448", "tag": "8e2ef947-6068-4749-9d9a-60018117a9f9"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:40:26.890580 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a5fa4c56-effd-4dea-9c26-e82d1ecca6f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:26.896844 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5fa4c56-effd-4dea-9c26-e82d1ecca6f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:26.897442 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5fa4c56-effd-4dea-9c26-e82d1ecca6f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:26.897974 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5fa4c56-effd-4dea-9c26-e82d1ecca6f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:26.898762 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5fa4c56-effd-4dea-9c26-e82d1ecca6f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:26.899361 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5fa4c56-effd-4dea-9c26-e82d1ecca6f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:26.899673 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-08846917-26ce-42a2-9d28-4f2940cc2d6c req-07b2db82-8b78-464c-94e2-7abb32231082 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:26.900038 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5fa4c56-effd-4dea-9c26-e82d1ecca6f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:26.900188 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-08846917-26ce-42a2-9d28-4f2940cc2d6c req-07b2db82-8b78-464c-94e2-7abb32231082 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:26.900561 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-08846917-26ce-42a2-9d28-4f2940cc2d6c req-07b2db82-8b78-464c-94e2-7abb32231082 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:26.912780 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-08846917-26ce-42a2-9d28-4f2940cc2d6c req-07b2db82-8b78-464c-94e2-7abb32231082 service nova] Creating event network-changed:8e2ef947-6068-4749-9d9a-60018117a9f9 for instance 2aa24417-8c8d-4180-9f39-d8267f508448 on hv-cinder-85220 Aug 18 14:40:26.918639 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-08846917-26ce-42a2-9d28-4f2940cc2d6c req-07b2db82-8b78-464c-94e2-7abb32231082 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032410 Aug 18 14:40:26.919417 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 525/1056] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:40:26.928821 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a5fa4c56-effd-4dea-9c26-e82d1ecca6f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:40:27.025513 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a5fa4c56-effd-4dea-9c26-e82d1ecca6f2 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 204 len: 0 microversion: 2.1 time: 0.140421 Aug 18 14:40:27.026533 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 532/1057] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:40:26 2022] DELETE /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:40:27.036759 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e84e61d3-21ac-4f2a-9065-e2f5ac455d4a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:27.037462 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e84e61d3-21ac-4f2a-9065-e2f5ac455d4a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:27.047247 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e84e61d3-21ac-4f2a-9065-e2f5ac455d4a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:27.048192 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e84e61d3-21ac-4f2a-9065-e2f5ac455d4a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:27.049245 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e84e61d3-21ac-4f2a-9065-e2f5ac455d4a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:27.050702 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e84e61d3-21ac-4f2a-9065-e2f5ac455d4a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:27.051571 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e84e61d3-21ac-4f2a-9065-e2f5ac455d4a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:27.052361 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e84e61d3-21ac-4f2a-9065-e2f5ac455d4a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:27.201835 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e84e61d3-21ac-4f2a-9065-e2f5ac455d4a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:40:27.209726 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e84e61d3-21ac-4f2a-9065-e2f5ac455d4a tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1568 microversion: 2.1 time: 0.178688 Aug 18 14:40:27.210302 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 526/1058] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:40:27 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:40:27.864622 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d889ca75-87cf-45eb-84c7-bb08477ac15f tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:27.865317 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d889ca75-87cf-45eb-84c7-bb08477ac15f tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 82de84e4-7336-4177-8dbc-fc57e2391d77] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:27.871622 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d889ca75-87cf-45eb-84c7-bb08477ac15f tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:27.872100 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d889ca75-87cf-45eb-84c7-bb08477ac15f tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:27.872576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d889ca75-87cf-45eb-84c7-bb08477ac15f tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:27.873343 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d889ca75-87cf-45eb-84c7-bb08477ac15f tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:27.873794 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d889ca75-87cf-45eb-84c7-bb08477ac15f tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:27.874213 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d889ca75-87cf-45eb-84c7-bb08477ac15f tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:27.887351 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-d889ca75-87cf-45eb-84c7-bb08477ac15f tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] HTTP exception thrown: Instance 82de84e4-7336-4177-8dbc-fc57e2391d77 could not be found. Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d889ca75-87cf-45eb-84c7-bb08477ac15f tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Request method failure captured: Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 HTTP/1.1 Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_k3QjMFB4Yq8KQTYkzSNN6uahNSzfzQvlBbXA_h-VdXt0nLslz12krAuVUynvHgr3_5OpLijn_LH4hN_kAQY5KGl2GbPUx1emP6CnJ55r2uFg5fLTFlSPVSVDOZNeyKqkhh6GGSaz4oROYv_rtmu5phJRbdLF7etf620QtmhW5XcIrY Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: e87465b1253547a49284b8be4673305d Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:40:27.889297 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:40:27.890985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e87465b1253547a49284b8be4673305d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e87465b1253547a49284b8be4673305d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e87465b1253547a49284b8be4673305d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e87465b1253547a49284b8be4673305d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:40:27.890985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:40:27.890985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: e87465b1253547a49284b8be4673305d Aug 18 14:40:27.890985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:40:27.890985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-TestVolumeBootPattern-1400655896-project Aug 18 14:40:27.890985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:40:27.890985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:40:27.890985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 3191363bf5794cfd91926141994e9d6b Aug 18 14:40:27.890985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-TestVolumeBootPattern-1400655896-project Aug 18 14:40:27.890985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:40:27.890985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance 82de84e4-7336-4177-8dbc-fc57e2391d77 could not be found. Aug 18 14:40:27.890985 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '82de84e4-7336-4177-8dbc-fc57e2391d77'} Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82de84e4-7336-4177-8dbc-fc57e2391d77 could not be found. Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:40:27.891999 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82de84e4-7336-4177-8dbc-fc57e2391d77 could not be found. Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82de84e4-7336-4177-8dbc-fc57e2391d77 could not be found. Aug 18 14:40:27.893638 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:27.895061 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d889ca75-87cf-45eb-84c7-bb08477ac15f tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Returning 404 to user: Instance 82de84e4-7336-4177-8dbc-fc57e2391d77 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:40:27.895061 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d889ca75-87cf-45eb-84c7-bb08477ac15f tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77" status: 404 len: 111 microversion: 2.1 time: 0.030264 Aug 18 14:40:27.895061 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 533/1059] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:40:27 2022] GET /compute/v2.1/servers/82de84e4-7336-4177-8dbc-fc57e2391d77 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:40:28.230383 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-802cd302-9027-46fa-8a29-1d711f55952d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:28.231011 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-802cd302-9027-46fa-8a29-1d711f55952d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:28.237599 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-802cd302-9027-46fa-8a29-1d711f55952d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:28.238303 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-802cd302-9027-46fa-8a29-1d711f55952d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:28.238742 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-802cd302-9027-46fa-8a29-1d711f55952d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:28.239464 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-802cd302-9027-46fa-8a29-1d711f55952d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:28.239924 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-802cd302-9027-46fa-8a29-1d711f55952d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:28.240349 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-802cd302-9027-46fa-8a29-1d711f55952d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:28.372401 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-802cd302-9027-46fa-8a29-1d711f55952d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:40:28.380175 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-802cd302-9027-46fa-8a29-1d711f55952d tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1568 microversion: 2.1 time: 0.153785 Aug 18 14:40:28.380738 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 527/1060] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:40:28 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:40:29.052966 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-80b07502-8d91-43dd-9496-5d59223e3689 req-18395d6b-b1e7-428b-84e1-40b21a12a201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aa24417-8c8d-4180-9f39-d8267f508448", "name": "network-vif-deleted", "tag": "8e2ef947-6068-4749-9d9a-60018117a9f9"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:40:29.063848 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-80b07502-8d91-43dd-9496-5d59223e3689 req-18395d6b-b1e7-428b-84e1-40b21a12a201 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:29.064335 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-80b07502-8d91-43dd-9496-5d59223e3689 req-18395d6b-b1e7-428b-84e1-40b21a12a201 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:29.064976 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-80b07502-8d91-43dd-9496-5d59223e3689 req-18395d6b-b1e7-428b-84e1-40b21a12a201 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:29.078153 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-80b07502-8d91-43dd-9496-5d59223e3689 req-18395d6b-b1e7-428b-84e1-40b21a12a201 service nova] Creating event network-vif-deleted:8e2ef947-6068-4749-9d9a-60018117a9f9 for instance 2aa24417-8c8d-4180-9f39-d8267f508448 on hv-cinder-85220 Aug 18 14:40:29.083878 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-80b07502-8d91-43dd-9496-5d59223e3689 req-18395d6b-b1e7-428b-84e1-40b21a12a201 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034474 Aug 18 14:40:29.084476 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 534/1061] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:40:29.403421 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f804841f-e2ee-4239-ba21-383dd8a0987f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:29.404048 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f804841f-e2ee-4239-ba21-383dd8a0987f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:29.411249 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f804841f-e2ee-4239-ba21-383dd8a0987f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:29.411852 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f804841f-e2ee-4239-ba21-383dd8a0987f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:29.412483 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f804841f-e2ee-4239-ba21-383dd8a0987f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:29.413101 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f804841f-e2ee-4239-ba21-383dd8a0987f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:29.413561 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f804841f-e2ee-4239-ba21-383dd8a0987f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:29.413995 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f804841f-e2ee-4239-ba21-383dd8a0987f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:29.490561 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f804841f-e2ee-4239-ba21-383dd8a0987f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21e6d2a2bba74fe1bea18a25f73d83d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03d2d48f0a554e579327d99976c599ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:40:29.499615 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f804841f-e2ee-4239-ba21-383dd8a0987f tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 200 len: 1220 microversion: 2.1 time: 0.100642 Aug 18 14:40:29.500193 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 528/1062] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:40:29 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:40:30.521112 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-92bcd960-ff83-419b-866d-695c1e8b0c28 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:30.521811 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-92bcd960-ff83-419b-866d-695c1e8b0c28 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] [instance: 2aa24417-8c8d-4180-9f39-d8267f508448] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:30.528095 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92bcd960-ff83-419b-866d-695c1e8b0c28 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:30.528576 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92bcd960-ff83-419b-866d-695c1e8b0c28 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:30.529089 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92bcd960-ff83-419b-866d-695c1e8b0c28 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:30.530087 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92bcd960-ff83-419b-866d-695c1e8b0c28 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:30.530573 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92bcd960-ff83-419b-866d-695c1e8b0c28 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:30.531002 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92bcd960-ff83-419b-866d-695c1e8b0c28 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:30.545894 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-92bcd960-ff83-419b-866d-695c1e8b0c28 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] HTTP exception thrown: Instance 2aa24417-8c8d-4180-9f39-d8267f508448 could not be found. Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-92bcd960-ff83-419b-866d-695c1e8b0c28 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Request method failure captured: Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 HTTP/1.1 Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_k5Y2k3xBJnlQLkKDewJCj0Y6QB72_Cpf7qXkCATfD7lF1o24lWO4ihi4pA3ta6lDJFayUqikp1KvU5VvskeH2YZVHtnpzefN2-sipnMp3EnZTl4h6Ma-7aSnIKnfSK_UZIFO9dvN4DaZH10-6iGxIqHSoJRW5GOWWLHNg6UscfZ7WI Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: 03d2d48f0a554e579327d99976c599ea Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-TestShelveInstance-462148694 Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:40:30.547165 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:40:30.548969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/03d2d48f0a554e579327d99976c599ea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_03d2d48f0a554e579327d99976c599ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/03d2d48f0a554e579327d99976c599ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/03d2d48f0a554e579327d99976c599ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:40:30.548969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-TestShelveInstance-462148694 Aug 18 14:40:30.548969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 03d2d48f0a554e579327d99976c599ea Aug 18 14:40:30.548969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-TestShelveInstance-462148694 Aug 18 14:40:30.548969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-TestShelveInstance-462148694-project Aug 18 14:40:30.548969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:40:30.548969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:40:30.548969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 21e6d2a2bba74fe1bea18a25f73d83d7 Aug 18 14:40:30.548969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-TestShelveInstance-462148694-project Aug 18 14:40:30.548969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:40:30.548969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance 2aa24417-8c8d-4180-9f39-d8267f508448 could not be found. Aug 18 14:40:30.548969 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '2aa24417-8c8d-4180-9f39-d8267f508448'} Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aa24417-8c8d-4180-9f39-d8267f508448 could not be found. Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:40:30.549958 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aa24417-8c8d-4180-9f39-d8267f508448 could not be found. Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aa24417-8c8d-4180-9f39-d8267f508448 could not be found. Aug 18 14:40:30.551479 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:30.552792 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-92bcd960-ff83-419b-866d-695c1e8b0c28 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Returning 404 to user: Instance 2aa24417-8c8d-4180-9f39-d8267f508448 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:40:30.552792 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-92bcd960-ff83-419b-866d-695c1e8b0c28 tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448" status: 404 len: 111 microversion: 2.1 time: 0.032169 Aug 18 14:40:30.552792 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 535/1063] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:40:30 2022] GET /compute/v2.1/servers/2aa24417-8c8d-4180-9f39-d8267f508448 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:40:30.712280 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b2112dee-cdae-49d6-8e44-dcfe6d3f865c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] Calling method '.version_select at 0x7fb621ea8af0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:30.753305 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b2112dee-cdae-49d6-8e44-dcfe6d3f865c tempest-TestShelveInstance-462148694 tempest-TestShelveInstance-462148694-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1140606863" status: 202 len: 0 microversion: 2.1 time: 0.045070 Aug 18 14:40:30.753939 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 529/1064] 10.222.0.39 () {58 vars in 1254 bytes} [Thu Aug 18 14:40:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1140606863 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:40:30.987253 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9673c5dc-b3b8-4b86-820c-5b7260eef073 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:30.988457 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9673c5dc-b3b8-4b86-820c-5b7260eef073 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:30.989785 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-006b9137-a06f-4df2-87ae-1b52cad3f69e req-1747bb5b-666e-488e-b8df-aae69de2bd32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ab7dd8d-369d-4bb1-b967-9154b171fb28", "tag": "8bad3cf2-cd2d-486e-b0f8-017d64cb688d"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:40:30.997591 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9673c5dc-b3b8-4b86-820c-5b7260eef073 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:30.998100 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9673c5dc-b3b8-4b86-820c-5b7260eef073 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:30.998735 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9673c5dc-b3b8-4b86-820c-5b7260eef073 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:30.999481 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9673c5dc-b3b8-4b86-820c-5b7260eef073 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:30.999949 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9673c5dc-b3b8-4b86-820c-5b7260eef073 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:31.000382 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9673c5dc-b3b8-4b86-820c-5b7260eef073 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:31.008141 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-006b9137-a06f-4df2-87ae-1b52cad3f69e req-1747bb5b-666e-488e-b8df-aae69de2bd32 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:31.009150 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-006b9137-a06f-4df2-87ae-1b52cad3f69e req-1747bb5b-666e-488e-b8df-aae69de2bd32 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:31.010507 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-006b9137-a06f-4df2-87ae-1b52cad3f69e req-1747bb5b-666e-488e-b8df-aae69de2bd32 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:31.025108 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-006b9137-a06f-4df2-87ae-1b52cad3f69e req-1747bb5b-666e-488e-b8df-aae69de2bd32 service nova] Creating event network-changed:8bad3cf2-cd2d-486e-b0f8-017d64cb688d for instance 3ab7dd8d-369d-4bb1-b967-9154b171fb28 on hv-cinder-85220 Aug 18 14:40:31.027397 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9673c5dc-b3b8-4b86-820c-5b7260eef073 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 14:40:31.032779 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-006b9137-a06f-4df2-87ae-1b52cad3f69e req-1747bb5b-666e-488e-b8df-aae69de2bd32 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045257 Aug 18 14:40:31.034567 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 530/1065] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 14:40:31.127994 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9673c5dc-b3b8-4b86-820c-5b7260eef073 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 204 len: 0 microversion: 2.1 time: 0.144815 Aug 18 14:40:31.129032 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 536/1066] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:40:30 2022] DELETE /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 14:40:31.139561 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7b11b13b-2ab0-4186-898e-0c375feb1f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:31.140276 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7b11b13b-2ab0-4186-898e-0c375feb1f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:31.148045 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b11b13b-2ab0-4186-898e-0c375feb1f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:31.148755 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b11b13b-2ab0-4186-898e-0c375feb1f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:31.149514 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b11b13b-2ab0-4186-898e-0c375feb1f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:31.150393 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b11b13b-2ab0-4186-898e-0c375feb1f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:31.151081 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b11b13b-2ab0-4186-898e-0c375feb1f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:31.151707 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b11b13b-2ab0-4186-898e-0c375feb1f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:31.297277 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7b11b13b-2ab0-4186-898e-0c375feb1f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:40:31.305856 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7b11b13b-2ab0-4186-898e-0c375feb1f51 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1577 microversion: 2.1 time: 0.172008 Aug 18 14:40:31.306726 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 531/1067] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:40:31 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:40:32.329830 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b6638e09-7aa2-4c87-906b-2025e1403bda tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:32.330541 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b6638e09-7aa2-4c87-906b-2025e1403bda tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:32.336931 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6638e09-7aa2-4c87-906b-2025e1403bda tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:32.337414 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6638e09-7aa2-4c87-906b-2025e1403bda tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:32.337846 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6638e09-7aa2-4c87-906b-2025e1403bda tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:32.338541 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6638e09-7aa2-4c87-906b-2025e1403bda tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:32.339290 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6638e09-7aa2-4c87-906b-2025e1403bda tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:32.340068 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6638e09-7aa2-4c87-906b-2025e1403bda tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:32.692282 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b6638e09-7aa2-4c87-906b-2025e1403bda tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:40:32.700290 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b6638e09-7aa2-4c87-906b-2025e1403bda tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1577 microversion: 2.1 time: 0.375514 Aug 18 14:40:32.700835 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 537/1068] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:40:32 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1577 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:40:33.320912 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-d3089139-5446-4cd8-a7f6-c7df64fac86a req-f32eed08-e881-46ac-b4f7-487a7b009a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab7dd8d-369d-4bb1-b967-9154b171fb28", "name": "network-vif-deleted", "tag": "8bad3cf2-cd2d-486e-b0f8-017d64cb688d"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 14:40:33.343348 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d3089139-5446-4cd8-a7f6-c7df64fac86a req-f32eed08-e881-46ac-b4f7-487a7b009a22 service nova] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:33.345228 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d3089139-5446-4cd8-a7f6-c7df64fac86a req-f32eed08-e881-46ac-b4f7-487a7b009a22 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:33.345947 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d3089139-5446-4cd8-a7f6-c7df64fac86a req-f32eed08-e881-46ac-b4f7-487a7b009a22 service nova] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:33.363643 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-d3089139-5446-4cd8-a7f6-c7df64fac86a req-f32eed08-e881-46ac-b4f7-487a7b009a22 service nova] Creating event network-vif-deleted:8bad3cf2-cd2d-486e-b0f8-017d64cb688d for instance 3ab7dd8d-369d-4bb1-b967-9154b171fb28 on hv-cinder-85220 Aug 18 14:40:33.371955 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-d3089139-5446-4cd8-a7f6-c7df64fac86a req-f32eed08-e881-46ac-b4f7-487a7b009a22 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056982 Aug 18 14:40:33.373025 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 532/1069] 10.222.0.39 () {64 vars in 1317 bytes} [Thu Aug 18 14:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 14:40:33.722242 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:33.723510 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:33.730659 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:33.731154 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:33.731615 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:33.732678 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:33.733139 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:33.733567 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:33.768151 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:33.768639 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:33.769069 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:33.769698 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lazy-loading 'fault' on Instance uuid 3ab7dd8d-369d-4bb1-b967-9154b171fb28 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 14:40:33.815485 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3191363bf5794cfd91926141994e9d6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87465b1253547a49284b8be4673305d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 14:40:33.823949 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-35ca494a-2e74-4ee7-b648-e73683eda727 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 200 len: 1231 microversion: 2.1 time: 0.105743 Aug 18 14:40:33.824891 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 538/1070] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:40:33 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 14:40:34.846938 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0ef22751-f81f-4777-9414-db3c815fb87e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:34.847672 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0ef22751-f81f-4777-9414-db3c815fb87e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 3ab7dd8d-369d-4bb1-b967-9154b171fb28] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:34.853774 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ef22751-f81f-4777-9414-db3c815fb87e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:34.854260 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ef22751-f81f-4777-9414-db3c815fb87e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:34.854703 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ef22751-f81f-4777-9414-db3c815fb87e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:34.855413 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ef22751-f81f-4777-9414-db3c815fb87e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:34.855875 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ef22751-f81f-4777-9414-db3c815fb87e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:34.856304 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ef22751-f81f-4777-9414-db3c815fb87e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:34.870986 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-0ef22751-f81f-4777-9414-db3c815fb87e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] HTTP exception thrown: Instance 3ab7dd8d-369d-4bb1-b967-9154b171fb28 could not be found. Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0ef22751-f81f-4777-9414-db3c815fb87e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Request method failure captured: Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 HTTP/1.1 Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_k3QjMFB4Yq8KQTYkzSNN6uahNSzfzQvlBbXA_h-VdXt0nLslz12krAuVUynvHgr3_5OpLijn_LH4hN_kAQY5KGl2GbPUx1emP6CnJ55r2uFg5fLTFlSPVSVDOZNeyKqkhh6GGSaz4oROYv_rtmu5phJRbdLF7etf620QtmhW5XcIrY Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: e87465b1253547a49284b8be4673305d Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:40:34.873730 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:40:34.875671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e87465b1253547a49284b8be4673305d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e87465b1253547a49284b8be4673305d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e87465b1253547a49284b8be4673305d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e87465b1253547a49284b8be4673305d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:40:34.875671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:40:34.875671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: e87465b1253547a49284b8be4673305d Aug 18 14:40:34.875671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:40:34.875671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-TestVolumeBootPattern-1400655896-project Aug 18 14:40:34.875671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:40:34.875671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:40:34.875671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 3191363bf5794cfd91926141994e9d6b Aug 18 14:40:34.875671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-TestVolumeBootPattern-1400655896-project Aug 18 14:40:34.875671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:40:34.875671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 3ab7dd8d-369d-4bb1-b967-9154b171fb28 could not be found. Aug 18 14:40:34.875671 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '3ab7dd8d-369d-4bb1-b967-9154b171fb28'} Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ab7dd8d-369d-4bb1-b967-9154b171fb28 could not be found. Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:40:34.877200 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ab7dd8d-369d-4bb1-b967-9154b171fb28 could not be found. Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ab7dd8d-369d-4bb1-b967-9154b171fb28 could not be found. Aug 18 14:40:34.878839 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:40:34.882658 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0ef22751-f81f-4777-9414-db3c815fb87e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Returning 404 to user: Instance 3ab7dd8d-369d-4bb1-b967-9154b171fb28 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:40:34.882658 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0ef22751-f81f-4777-9414-db3c815fb87e tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28" status: 404 len: 111 microversion: 2.1 time: 0.033344 Aug 18 14:40:34.882658 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 533/1071] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:40:34 2022] GET /compute/v2.1/servers/3ab7dd8d-369d-4bb1-b967-9154b171fb28 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:40:35.964159 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8fe79b45-65ae-4356-a2a9-202aa6d10bcc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:35.964713 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8fe79b45-65ae-4356-a2a9-202aa6d10bcc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:35.973173 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8fe79b45-65ae-4356-a2a9-202aa6d10bcc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:35.973656 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8fe79b45-65ae-4356-a2a9-202aa6d10bcc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:35.974092 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8fe79b45-65ae-4356-a2a9-202aa6d10bcc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:35.974778 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8fe79b45-65ae-4356-a2a9-202aa6d10bcc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:35.975225 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8fe79b45-65ae-4356-a2a9-202aa6d10bcc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:35.975669 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8fe79b45-65ae-4356-a2a9-202aa6d10bcc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:35.990222 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-8fe79b45-65ae-4356-a2a9-202aa6d10bcc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] HTTP exception thrown: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8fe79b45-65ae-4356-a2a9-202aa6d10bcc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Request method failure captured: Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 HTTP/1.1 Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Host: 10.222.0.39 Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_k3QjMFB4Yq8KQTYkzSNN6uahNSzfzQvlBbXA_h-VdXt0nLslz12krAuVUynvHgr3_5OpLijn_LH4hN_kAQY5KGl2GbPUx1emP6CnJ55r2uFg5fLTFlSPVSVDOZNeyKqkhh6GGSaz4oROYv_rtmu5phJRbdLF7etf620QtmhW5XcIrY Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Id: e87465b1253547a49284b8be4673305d Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Role: reader,member Aug 18 14:40:35.991907 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Roles: reader,member Aug 18 14:40:35.993693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e87465b1253547a49284b8be4673305d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e87465b1253547a49284b8be4673305d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e87465b1253547a49284b8be4673305d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e87465b1253547a49284b8be4673305d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:40:35.993693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:40:35.993693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Id: e87465b1253547a49284b8be4673305d Aug 18 14:40:35.993693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:40:35.993693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User: tempest-TestVolumeBootPattern-1400655896-project Aug 18 14:40:35.993693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 14:40:35.993693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 14:40:35.993693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Id: 3191363bf5794cfd91926141994e9d6b Aug 18 14:40:35.993693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-TestVolumeBootPattern-1400655896-project Aug 18 14:40:35.993693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: method: > Aug 18 14:40:35.993693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: exception: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:40:35.993693 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: action_args: {'id': '16f49170-7caf-4e52-8328-d67867701796'} Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:40:35.994600 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:40:35.996295 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 14:40:35.998157 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8fe79b45-65ae-4356-a2a9-202aa6d10bcc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Returning 404 to user: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:40:35.998157 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8fe79b45-65ae-4356-a2a9-202aa6d10bcc tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "DELETE /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 404 len: 111 microversion: 2.1 time: 0.033437 Aug 18 14:40:35.998157 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 539/1072] 10.222.0.39 () {58 vars in 1239 bytes} [Thu Aug 18 14:40:35 2022] DELETE /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:40:36.003004 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7f9c1a17-fc64-4c66-8006-44705dfc2743 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:36.003799 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7f9c1a17-fc64-4c66-8006-44705dfc2743 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] [instance: 16f49170-7caf-4e52-8328-d67867701796] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 14:40:36.010256 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f9c1a17-fc64-4c66-8006-44705dfc2743 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:36.010837 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f9c1a17-fc64-4c66-8006-44705dfc2743 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:36.011265 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f9c1a17-fc64-4c66-8006-44705dfc2743 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:36.012022 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f9c1a17-fc64-4c66-8006-44705dfc2743 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Acquiring lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 14:40:36.012484 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f9c1a17-fc64-4c66-8006-44705dfc2743 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 14:40:36.012912 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f9c1a17-fc64-4c66-8006-44705dfc2743 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Lock "c88e209a-0f4b-4562-a6ce-d78b951fe397" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 14:40:36.026582 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-7f9c1a17-fc64-4c66-8006-44705dfc2743 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] HTTP exception thrown: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7f9c1a17-fc64-4c66-8006-44705dfc2743 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Request method failure captured: Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 HTTP/1.1 Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Host: 10.222.0.39 Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_k3QjMFB4Yq8KQTYkzSNN6uahNSzfzQvlBbXA_h-VdXt0nLslz12krAuVUynvHgr3_5OpLijn_LH4hN_kAQY5KGl2GbPUx1emP6CnJ55r2uFg5fLTFlSPVSVDOZNeyKqkhh6GGSaz4oROYv_rtmu5phJRbdLF7etf620QtmhW5XcIrY Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Id: e87465b1253547a49284b8be4673305d Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Role: reader,member Aug 18 14:40:36.028075 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Roles: reader,member Aug 18 14:40:36.030092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e87465b1253547a49284b8be4673305d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e87465b1253547a49284b8be4673305d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e87465b1253547a49284b8be4673305d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e87465b1253547a49284b8be4673305d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}] Aug 18 14:40:36.030092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:40:36.030092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Id: e87465b1253547a49284b8be4673305d Aug 18 14:40:36.030092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1400655896 Aug 18 14:40:36.030092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User: tempest-TestVolumeBootPattern-1400655896-project Aug 18 14:40:36.030092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 14:40:36.030092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 14:40:36.030092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Id: 3191363bf5794cfd91926141994e9d6b Aug 18 14:40:36.030092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-TestVolumeBootPattern-1400655896-project Aug 18 14:40:36.030092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: method: > Aug 18 14:40:36.030092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: exception: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:40:36.030092 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: action_args: {'id': '16f49170-7caf-4e52-8328-d67867701796'} Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 14:40:36.031515 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. Aug 18 14:40:36.033103 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 14:40:36.035576 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7f9c1a17-fc64-4c66-8006-44705dfc2743 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Returning 404 to user: Instance 16f49170-7caf-4e52-8328-d67867701796 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 14:40:36.035576 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7f9c1a17-fc64-4c66-8006-44705dfc2743 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796" status: 404 len: 111 microversion: 2.1 time: 0.031282 Aug 18 14:40:36.035576 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 534/1073] 10.222.0.39 () {58 vars in 1236 bytes} [Thu Aug 18 14:40:35 2022] GET /compute/v2.1/servers/16f49170-7caf-4e52-8328-d67867701796 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 14:40:37.341568 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-edcc60f5-6a1a-45ea-9141-b04ea0723326 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] Calling method '.version_select at 0x7fb6221a61f0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 14:40:37.369996 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-edcc60f5-6a1a-45ea-9141-b04ea0723326 tempest-TestVolumeBootPattern-1400655896 tempest-TestVolumeBootPattern-1400655896-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1701044862" status: 202 len: 0 microversion: 2.1 time: 0.032538 Aug 18 14:40:37.370848 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 540/1074] 10.222.0.39 () {58 vars in 1263 bytes} [Thu Aug 18 14:40:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1701044862 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 14:41:50.191694 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 14:41:50.192561 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Thu Aug 18 14:41:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 14:41:51.475513 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 14:41:51.476037 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Thu Aug 18 14:41:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 14:43:31.097696 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 14:43:31.098232 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Thu Aug 18 14:43:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 14:43:47.916226 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 14:43:47.916862 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Thu Aug 18 14:43:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 14:43:49.420789 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 14:43:49.421286 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Thu Aug 18 14:43:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 14:45:10.199763 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 14:45:10.200385 dv-cinder-852209-4-iscsi devstack@n-api.service[120538]: Thu Aug 18 14:45:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 14:45:11.484747 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 14:45:11.485281 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Thu Aug 18 14:45:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 14:45:31.619581 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 14:45:31.620102 dv-cinder-852209-4-iscsi devstack@n-api.service[120539]: Thu Aug 18 14:45:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!